Jul 30 16:22:14 devstack cinder-volume[76565]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:22:14 devstack cinder-volume[76565]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:22:14 devstack cinder-volume[76565]: we strongly recommend against using it for new projects. Jul 30 16:22:14 devstack cinder-volume[76565]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:22:14 devstack cinder-volume[76565]: framework. For more detail see Jul 30 16:22:14 devstack cinder-volume[76565]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:22:14 devstack cinder-volume[76565]: import eventlet # noqa Jul 30 16:22:16 devstack cinder-volume[76565]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:22:16 devstack cinder-volume[76565]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:22:16 devstack cinder-volume[76565]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:22:17 devstack cinder-volume[76565]: INFO dbcounter [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Registered counter for database cinder Jul 30 16:22:18 devstack cinder-volume[76565]: DEBUG oslo_db.sqlalchemy.engines [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:22:18 devstack cinder-volume[76565]: DEBUG dbcounter [-] [76565] Writer thread running {{(pid=76565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:22:18 devstack cinder-volume[76565]: INFO cinder.rpc [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:22:18 devstack cinder-volume[76565]: INFO cinder.rpc [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:22:18 devstack cinder-volume[76565]: DEBUG oslo_db.sqlalchemy.engines [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:22:18 devstack cinder-volume[76565]: INFO cinder.volume.manager [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Determined volume DB was empty at startup. Jul 30 16:22:18 devstack cinder-volume[76565]: DEBUG cinder.volume.manager [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76565) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:22:18 devstack cinder-volume[76565]: INFO cinder.volume.manager [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 16:22:18 devstack cinder-volume[76565]: WARNING stevedore.named [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:22:18 devstack cinder-volume[76565]: WARNING castellan.key_manager [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:22:18 devstack cinder-volume[76565]: WARNING cinder.keymgr.conf_key_mgr [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:22:18 devstack cinder-volume[76565]: DEBUG cinder.volume.drivers.lvm [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76565) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 30 16:22:18 devstack cinder-volume[76565]: DEBUG oslo_concurrency.processutils [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_concurrency.processutils [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] CMD "cinder-rtstool verify" returned: 0 in 0.444s {{(pid=76565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_db.sqlalchemy.engines [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:22:19 devstack cinder-volume[76565]: INFO cinder.rpc [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 30 16:22:19 devstack cinder-volume[76565]: INFO cinder.rpc [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 30 16:22:19 devstack cinder-volume[76565]: WARNING stevedore.named [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:22:19 devstack cinder-volume[76565]: WARNING castellan.key_manager [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:22:19 devstack cinder-volume[76565]: INFO cinder.volume.manager [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_db.sqlalchemy.engines [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:22:19 devstack cinder-volume[76565]: INFO oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Starting 1 workers Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Started child 76763 {{(pid=76565) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Full set of CONF: {{(pid=76565) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] ******************************************************************************** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Configuration options gathered from: {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] ================================================================================ {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:22:19 devstack cinder-volume[76763]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] allow_availability_zone_fallback = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] allow_compression_on_image_upload = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] allowed_direct_url_schemes = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] api_rate_limit = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] auth_strategy = keystone {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] az_cache_duration = 3600 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_availability_zone = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_host = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_stats_polling_interval = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backup_api_class = cinder.backup.api.API {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backup_name_template = backup-%s {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backup_use_same_host = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backup_use_temp_snapshot = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] chap_password = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] chap_username = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_internal_tenant_project_id = 4666f887bdb146ef856a026f690a8a43 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_internal_tenant_user_id = 7d77ded8eed142ceb318669c6cb601af {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cloned_volume_same_az = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cluster = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] compression_format = gzip {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] compute_api_class = cinder.compute.nova.API {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] config_dir = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] config_source = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] control_exchange = openstack {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] debug = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] default_availability_zone = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] default_group_type = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] default_volume_type = lvmdriver-1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] disk_geometry = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] driver_client_cert = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] driver_client_cert_key = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] driver_data_namespace = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] driver_ssl_cert_path = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] driver_ssl_cert_verify = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] driver_use_ssl = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] enable_force_upload = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] enable_new_services = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] enable_unsupported_driver = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] enabled_backends = ['lvmdriver-1'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] enforce_multipath_for_image_xfer = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] filter_function = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_api_insecure = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_api_servers = ['http://192.168.122.12/image'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_api_ssl_compression = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_ca_certificates_file = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_catalog_info = image:glance:publicURL {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_certfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_keyfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_num_retries = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance_request_timeout = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] goodness_function = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] graceful_shutdown_timeout = 5 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] group_api_class = cinder.group.api.API {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] host = devstack {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_compress_on_upload = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_conversion_address_space_limit = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_conversion_cpu_limit = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_conversion_disable = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_upload_use_cinder_backend = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_upload_use_internal_tenant = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_volume_cache_enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_volume_cache_max_count = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] image_volume_cache_max_size_gb = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] init_host_max_objects_retrieval = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] instance_format = [instance: %(uuid)s] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] iscsi_target_flags = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] iscsi_write_cache = on {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] iser_helper = tgtadm {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] iser_ip_address = 192.168.122.12 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76763]: INFO cinder.volume.manager [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] iser_port = 3260 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_color = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_config_append = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_dir = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_file = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_options = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_rotate_interval = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_rotate_interval_type = days {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] log_rotation_type = none {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] max_age = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] max_logfile_count = 30 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] max_logfile_size_mb = 200 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] max_over_subscription_ratio = 20.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] message_reap_interval = 86400 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] message_ttl = 2592000 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] migration_create_volume_timeout_secs = 300 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] monkey_patch = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] monkey_patch_modules = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] my_ip = 192.168.122.12 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] no_snapshot_gb_quota = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] num_iser_scan_tries = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] num_shell_tries = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] num_volume_device_scan_tries = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] nvmeof_conn_info_version = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] nvmet_ns_id = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] nvmet_port_id = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] osapi_max_limit = 1000 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] osapi_volume_ext_list = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] osapi_volume_listen = 0.0.0.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] osapi_volume_listen_port = 8776 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] osapi_volume_use_ssl = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] osapi_volume_workers = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] per_volume_size_limit = -1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] periodic_fuzzy_delay = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] periodic_interval = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] project_id_regex = [0-9a-f\-]+ {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] public_endpoint = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] publish_errors = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] quota_backup_gigabytes = 1000 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] quota_backups = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] quota_gigabytes = 1000 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] quota_groups = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] quota_snapshots = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] quota_volumes = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] rate_limit_burst = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] rate_limit_except_level = CRITICAL {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] rate_limit_interval = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] reinit_driver_count = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] replication_device = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] report_discard_supported = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] report_interval = 120 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] reservation_clean_interval = 86400 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] reservation_expire = 86400 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] reserved_image_namespaces = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] reserved_percentage = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] rpc_response_timeout = 120 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] run_external_periodic_tasks = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] scst_target_driver = iscsi {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] scst_target_iqn_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_down_time = 720 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] shell_completion = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] snapshot_name_template = snapshot-%s {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] snapshot_same_host = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] split_loggers = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] state_path = /opt/stack/data/cinder {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] storage_availability_zone = nova {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] storage_protocol = iSCSI {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] syslog_log_facility = LOG_USER {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] target_helper = lioadm {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] target_ip_address = 192.168.122.12 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] target_port = 3260 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] target_protocol = iscsi {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] target_secondary_ip_addresses = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] trace_flags = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] transfer_api_class = cinder.transfer.api.API {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] transport_url = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] until_refresh = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] use_chap_auth = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] use_default_quota_class = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] use_journal = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] use_json = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] use_multipath_for_image_xfer = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] use_stderr = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] use_syslog = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] verify_glance_signatures = enabled {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_api_class = cinder.volume.api.API {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_backend_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_clear = zero {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_clear_ionice = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_clear_size = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_copy_bps_limit = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_dd_blocksize = 1M {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_name_template = volume-%s {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_service_inithost_offload = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volume_usage_audit_period = month {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] zoning_mode = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_concurrency.disable_process_locking = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.auth_section = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.auth_type = password {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.auth_version = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.cache = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.certfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.delay_auth_decision = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.http_connect_timeout = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.include_service_catalog = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.insecure = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.interface = public {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.keyfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_password = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcache_username = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.region_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.service_token_roles_required = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.service_type = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.token_cache_time = 300 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.12/identity {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.backend = dogpile.cache.null {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.backend_argument = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.backend_expiration_time = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.config_prefix = cache.oslo {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.debug_cache_backend = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.enable_retry_client = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.enable_socket_keepalive = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.expiration_time = 600 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.hashclient_retry_attempts = 2 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.memcache_dead_retry = 300 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.memcache_pool_maxsize = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.memcache_sasl_enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.password = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.proxies = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.redis_db = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.redis_sentinel_service_name = mymaster {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.redis_server = localhost:6379 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.retry_attempts = 2 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.retry_delay = 0.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.socket_keepalive_count = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.socket_keepalive_idle = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.socket_keepalive_interval = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.socket_timeout = 1.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.tls_allowed_ciphers = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.tls_cafile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.tls_certfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.tls_enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.tls_keyfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cache.username = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] coordination.backend_url = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.asyncio_connection = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.asyncio_slave_connection = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.backend = sqlalchemy {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.connection = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.connection_debug = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.connection_parameters = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.connection_recycle_time = 3600 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.connection_trace = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.db_inc_retry_interval = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.db_max_retries = 20 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.db_max_retry_interval = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.db_retry_interval = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.max_overflow = 50 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.max_pool_size = 5 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.max_retries = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.mysql_wsrep_sync_wait = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.pool_timeout = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.retry_interval = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.slave_connection = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.sqlite_synchronous = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.synchronous_reader = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] database.use_db_reconnect = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack sudo[76767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.connection_string = messaging:// {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.es_doc_type = notification {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.es_scroll_size = 10000 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.es_scroll_time = 2m {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.filter_error_trace = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.hmac_keys = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.sentinel_service_name = mymaster {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.socket_timeout = 0.1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack sudo[76767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.trace_requests = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler.trace_sqlalchemy = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler_jaeger.process_tags = {} {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler_jaeger.service_name_prefix = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] profiler_otlp.service_name_prefix = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.enforce_new_defaults = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.policy_default_rule = default {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.policy_file = policy.yaml {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_policy.remote_timeout = 60.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] privsep_osbrick.group = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] privsep_osbrick.helper_command = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] privsep_osbrick.user = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_sys_admin.group = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_sys_admin.helper_command = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] cinder_sys_admin.user = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.auth_section = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.auth_type = password {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.cafile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.certfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.collect_timing = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.insecure = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.keyfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.send_service_user_token = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.split_loggers = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] service_user.timeout = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.auth_section = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.auth_type = password {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.certfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.collect_timing = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.insecure = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.keyfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.region_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.split_loggers = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] glance.timeout = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.backend_availability_zone = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.chap_password = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.chap_username = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.disk_geometry = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.driver_client_cert = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.driver_client_cert_key = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.driver_data_namespace = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.driver_use_ssl = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.enable_unsupported_driver = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.extra_capabilities = {} {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.filter_function = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.goodness_function = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.iscsi_target_flags = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.iscsi_write_cache = on {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.iser_helper = tgtadm {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.iser_ip_address = 192.168.122.12 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.iser_port = 3260 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.lvm_mirrors = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.lvm_share_target = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.lvm_type = auto {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.num_shell_tries = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.nvmet_port_id = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.replication_device = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.report_discard_supported = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.reserved_percentage = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.scst_target_driver = iscsi {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.scst_target_iqn_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.storage_protocol = iSCSI {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.target_helper = tgtadm {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.target_ip_address = 192.168.122.12 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.target_port = 3260 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.target_protocol = iscsi {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.trace_flags = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.unique_fqdn_network = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.use_chap_auth = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_backend_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_clear = zero {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_clear_ionice = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_clear_size = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volume_group = cinder-volumes {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_reports.file_event_handler = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_reports.log_dir = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.backend_availability_zone = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.backend_host = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.chap_password = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.chap_username = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.chiscsi_conf = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.disk_geometry = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.driver_client_cert = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.driver_data_namespace = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.driver_use_ssl = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.extra_capabilities = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.filter_function = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.goodness_function = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.iser_helper = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.iser_ip_address = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.iser_port = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.iser_target_prefix = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.lvm_conf_file = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.lvm_mirrors = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.lvm_share_target = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.lvm_type = auto {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.num_shell_tries = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.nvmet_port_id = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.replication_device = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.report_discard_supported = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.reserved_percentage = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.scst_target_driver = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.storage_protocol = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.target_helper = lioadm {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.target_ip_address = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.target_port = 3260 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.target_protocol = iscsi {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.trace_flags = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.use_chap_auth = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_clear = zero {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_clear_size = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] lvmdriver-1.volumes_dir = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.ssl = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.ssl_version = {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_notifications.driver = [] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_notifications.retry = -1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] oslo_messaging_notifications.transport_url = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] key_manager.fixed_key = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.barbican_api_version = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.barbican_endpoint = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.barbican_endpoint_type = public {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.barbican_region_name = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.cafile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.certfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.collect_timing = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.insecure = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.keyfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.number_of_retries = 60 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.retry_delay = 1 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.send_service_user_token = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.split_loggers = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.timeout = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.verify_ssl = True {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican.verify_ssl_path = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.auth_section = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.auth_type = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.cafile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.certfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.collect_timing = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.insecure = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.keyfile = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.split_loggers = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] barbican_service_user.timeout = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.approle_role_id = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.approle_secret_id = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.auth_method = approle {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.auth_path = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.kv_mountpoint = secret {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.kv_path = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.kv_version = 2 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.namespace = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.root_token_id = **** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.ssl_ca_crt_file = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.timeout = 60.0 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.token_file = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.token_role = None {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.use_ssl = False {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:22:19 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] ******************************************************************************** {{(pid=76565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:22:19 devstack sudo[76767]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:19 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:19 devstack sudo[76770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:19 devstack sudo[76770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:20 devstack sudo[76770]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.306s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:22:20 devstack cinder-volume[76763]: INFO cinder.brick.local_dev.lvm [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:20 devstack sudo[76883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:22:20 devstack sudo[76883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:20 devstack sudo[76883]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG cinder.brick.local_dev.lvm [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76763) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:20 devstack sudo[76977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:20 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:20 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.499s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:20 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:20 devstack sudo[77164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:20 devstack sudo[77164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:21 devstack sudo[77164]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:21 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:21 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:21 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:21 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:21 devstack sudo[77264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 30 16:22:21 devstack sudo[77264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:21 devstack sudo[77264]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:21 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.293s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:21 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:21 devstack sudo[77381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:22:21 devstack sudo[77381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:21 devstack sudo[77381]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:21 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:21 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:21 devstack sudo[77384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:22:21 devstack sudo[77384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:22 devstack sudo[77384]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:22 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:22 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:22 devstack sudo[77467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:22:22 devstack sudo[77467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:22 devstack sudo[77467]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:22 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:22 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:22 devstack sudo[77470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:22 devstack sudo[77470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:22 devstack sudo[77470]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:22 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:22 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:22 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:22 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:22 devstack sudo[77507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:22 devstack sudo[77507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:23 devstack sudo[77507]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.325s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:23 devstack cinder-volume[76763]: INFO cinder.volume.drivers.lvm [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:23 devstack sudo[77564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:23 devstack sudo[77564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:23 devstack sudo[77564]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG cinder.volume.drivers.lvm [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Updating volume stats {{(pid=76763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:23 devstack sudo[77567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:22:23 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:23 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:23 devstack sudo[77570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:22:23 devstack sudo[77570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:23 devstack sudo[77570]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:23 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:23 devstack sudo[77573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:23 devstack sudo[77573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:24 devstack sudo[77573]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:24 devstack sudo[77576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:22:24 devstack sudo[77576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:24 devstack sudo[77576]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:24 devstack cinder-volume[76763]: INFO cinder.volume.driver [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG cinder.volume.driver [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76763) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG oslo_db.sqlalchemy.engines [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG dbcounter [-] [76763] Writer thread running {{(pid=76763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG cinder.db.api [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Building query based on filter {{(pid=76763) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG cinder.image.image_utils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76763) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:22:24 devstack cinder-volume[76763]: INFO cinder.keymgr.migration [None req-48af11ec-5db7-4708-be1a-eac34b13cc79 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG cinder.volume.drivers.lvm [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Updating volume stats {{(pid=76763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:24 devstack sudo[77585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:22:24 devstack sudo[77585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:24 devstack sudo[77585]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:24 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:24 devstack sudo[77588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:22:24 devstack sudo[77588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:25 devstack sudo[77588]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:25 devstack sudo[77593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:25 devstack sudo[77593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:25 devstack sudo[77593]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:25 devstack sudo[77596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:22:25 devstack sudo[77596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:25 devstack sudo[77596]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG cinder.manager [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Notifying Schedulers of capabilities ... {{(pid=76763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:22:25 devstack cinder-volume[76763]: INFO cinder.volume.manager [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Driver initialization completed successfully. Jul 30 16:22:25 devstack cinder-volume[76763]: INFO cinder.manager [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Initiating service 2 cleanup Jul 30 16:22:25 devstack cinder-volume[76763]: INFO cinder.manager [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Service 2 cleanup completed. Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG cinder.service [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Creating RPC server for service cinder-volume {{(pid=76763) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG cinder.service [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76763) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:22:25 devstack cinder-volume[76763]: INFO cinder.volume.manager [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG cinder.volume.drivers.lvm [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Updating volume stats {{(pid=76763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:22:25 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:25 devstack sudo[77601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:22:25 devstack sudo[77601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:26 devstack sudo[77601]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:26 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:26 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:26 devstack sudo[77605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:22:26 devstack sudo[77605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:26 devstack sudo[77605]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:26 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:26 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:26 devstack sudo[77608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:22:26 devstack sudo[77608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:26 devstack sudo[77608]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:26 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:26 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:22:26 devstack sudo[77611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:22:26 devstack sudo[77611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:22:26 devstack sudo[77611]: pam_unix(sudo:session): session closed for user root Jul 30 16:22:26 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:22:26 devstack cinder-volume[76763]: INFO cinder.volume.manager [None req-7f7688b4-7216-4675-bbb7-1ee957ebe97f None None] Driver post RPC initialization completed successfully. Jul 30 16:22:29 devstack cinder-volume[76565]: DEBUG dbcounter [-] [76565] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:22:30 devstack cinder-volume[76763]: DEBUG oslo_service.periodic_task [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running periodic task VolumeManager._thread_info {{(pid=76763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:22:30 devstack cinder-volume[76763]: DEBUG cinder.volume.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] thread count: 6 {{(pid=76763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:22:30 devstack cinder-volume[76763]: DEBUG cinder.volume.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] thread info: [<_MainThread(MainThread, started 139764726415488)>, , , , , ] {{(pid=76763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:22:36 devstack cinder-volume[76763]: DEBUG dbcounter [-] [76763] Writing DB stats cinder:SELECT=2 {{(pid=76763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:22:36 devstack cinder-volume[76763]: DEBUG dbcounter [-] [76763] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:23:30 devstack cinder-volume[76763]: DEBUG oslo_service.periodic_task [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:23:30 devstack cinder-volume[76763]: DEBUG cinder.volume.drivers.lvm [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Updating volume stats {{(pid=76763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:23:30 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:23:30 devstack sudo[79664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:23:30 devstack sudo[79664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:23:31 devstack sudo[79664]: pam_unix(sudo:session): session closed for user root Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:23:31 devstack sudo[79667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:23:31 devstack sudo[79667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:23:31 devstack sudo[79667]: pam_unix(sudo:session): session closed for user root Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:23:31 devstack sudo[79670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:23:31 devstack sudo[79670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:23:31 devstack sudo[79670]: pam_unix(sudo:session): session closed for user root Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:23:31 devstack sudo[79673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:23:31 devstack sudo[79673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:23:31 devstack sudo[79673]: pam_unix(sudo:session): session closed for user root Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG cinder.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Notifying Schedulers of capabilities ... {{(pid=76763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG oslo_service.periodic_task [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running periodic task VolumeManager._thread_info {{(pid=76763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG cinder.volume.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] thread count: 6 {{(pid=76763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:23:31 devstack cinder-volume[76763]: DEBUG cinder.volume.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] thread info: [<_MainThread(MainThread, started 139764726415488)>, , , , , ] {{(pid=76763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:24:30 devstack cinder-volume[76763]: DEBUG oslo_service.periodic_task [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:24:30 devstack cinder-volume[76763]: DEBUG cinder.volume.drivers.lvm [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Updating volume stats {{(pid=76763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:24:30 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:24:30 devstack sudo[83018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:24:30 devstack sudo[83018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:24:31 devstack sudo[83018]: pam_unix(sudo:session): session closed for user root Jul 30 16:24:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:24:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:24:31 devstack sudo[83022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:24:31 devstack sudo[83022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:24:31 devstack sudo[83022]: pam_unix(sudo:session): session closed for user root Jul 30 16:24:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:24:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:24:31 devstack sudo[83026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:24:31 devstack sudo[83026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:24:31 devstack sudo[83026]: pam_unix(sudo:session): session closed for user root Jul 30 16:24:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:24:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:24:31 devstack sudo[83033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:24:31 devstack sudo[83033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:24:31 devstack sudo[83033]: pam_unix(sudo:session): session closed for user root Jul 30 16:24:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:24:31 devstack cinder-volume[76763]: DEBUG cinder.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Notifying Schedulers of capabilities ... {{(pid=76763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:24:36 devstack cinder-volume[76763]: DEBUG dbcounter [-] [76763] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:25:30 devstack cinder-volume[76763]: DEBUG oslo_service.periodic_task [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:25:30 devstack cinder-volume[76763]: DEBUG cinder.volume.drivers.lvm [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Updating volume stats {{(pid=76763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:25:30 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:25:30 devstack sudo[85491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:25:30 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:25:31 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:25:31 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:25:31 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:25:31 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:25:31 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:25:31 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:25:31 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:25:31 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:25:31 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:25:31 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG cinder.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Notifying Schedulers of capabilities ... {{(pid=76763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG oslo_service.periodic_task [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running periodic task VolumeManager._thread_info {{(pid=76763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG cinder.volume.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] thread count: 6 {{(pid=76763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:25:31 devstack cinder-volume[76763]: DEBUG cinder.volume.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] thread info: [<_MainThread(MainThread, started 139764726415488)>, , , , , ] {{(pid=76763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:26:30 devstack cinder-volume[76763]: DEBUG oslo_service.periodic_task [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:26:30 devstack cinder-volume[76763]: DEBUG cinder.volume.drivers.lvm [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Updating volume stats {{(pid=76763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:26:30 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:30 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:26:30 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:26:31 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:31 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:26:31 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:26:31 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:31 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:26:31 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:26:31 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:31 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:26:31 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:26:31 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG oslo_concurrency.processutils [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG cinder.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Notifying Schedulers of capabilities ... {{(pid=76763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG oslo_service.periodic_task [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] Running periodic task VolumeManager._thread_info {{(pid=76763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG cinder.volume.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] thread count: 6 {{(pid=76763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:26:31 devstack cinder-volume[76763]: DEBUG cinder.volume.manager [None req-e4759621-2f68-4ad7-a9d3-f794498f9d8f None None] thread info: [<_MainThread(MainThread, started 139764726415488)>, , , , , ] {{(pid=76763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:26:36 devstack cinder-volume[76763]: DEBUG dbcounter [-] [76763] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:26:45 devstack cinder-volume[76565]: INFO oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Caught SIGTERM, stopping children Jul 30 16:26:45 devstack cinder-volume[76565]: DEBUG oslo_concurrency.lockutils [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Acquiring lock "singleton_lock" {{(pid=76565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:26:45 devstack cinder-volume[76565]: DEBUG oslo_concurrency.lockutils [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Acquired lock "singleton_lock" {{(pid=76565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:26:45 devstack cinder-volume[76565]: DEBUG oslo_concurrency.lockutils [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Releasing lock "singleton_lock" {{(pid=76565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:26:45 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Stop services. {{(pid=76565) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 30 16:26:45 devstack cinder-volume[76565]: DEBUG oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Killing children. {{(pid=76565) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 30 16:26:45 devstack cinder-volume[76565]: INFO oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Waiting on 1 children to exit Jul 30 16:26:50 devstack cinder-volume[76763]: DEBUG oslo_concurrency.lockutils [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Acquiring lock "singleton_lock" {{(pid=76763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:26:50 devstack cinder-volume[76763]: DEBUG oslo_concurrency.lockutils [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Acquired lock "singleton_lock" {{(pid=76763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:26:50 devstack cinder-volume[76763]: DEBUG oslo_concurrency.lockutils [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Releasing lock "singleton_lock" {{(pid=76763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:26:50 devstack cinder-volume[76763]: WARNING amqp [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:26:50 devstack cinder-volume[76763]: WARNING amqp [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:26:50 devstack cinder-volume[76565]: INFO oslo_service.backend._eventlet.service [None req-85b4632a-d2cb-4530-ae2f-cd9920a5eeaa None None] Child 76763 exited with status 0 Jul 30 16:26:51 devstack cinder-volume[87264]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:26:51 devstack cinder-volume[87264]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:26:51 devstack cinder-volume[87264]: we strongly recommend against using it for new projects. Jul 30 16:26:51 devstack cinder-volume[87264]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:26:51 devstack cinder-volume[87264]: framework. For more detail see Jul 30 16:26:51 devstack cinder-volume[87264]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:26:51 devstack cinder-volume[87264]: import eventlet # noqa Jul 30 16:26:53 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:26:53 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:26:53 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:26:53 devstack cinder-volume[87264]: INFO dbcounter [None req-eda80d20-65be-4700-b321-638827849abc None None] Registered counter for database cinder Jul 30 16:26:53 devstack cinder-volume[87264]: DEBUG oslo_db.sqlalchemy.engines [None req-eda80d20-65be-4700-b321-638827849abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG dbcounter [-] [87264] Writer thread running {{(pid=87264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:26:54 devstack cinder-volume[87264]: INFO cinder.rpc [None req-eda80d20-65be-4700-b321-638827849abc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:26:54 devstack cinder-volume[87264]: INFO cinder.rpc [None req-eda80d20-65be-4700-b321-638827849abc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_db.sqlalchemy.engines [None req-eda80d20-65be-4700-b321-638827849abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:26:54 devstack cinder-volume[87264]: INFO cinder.volume.manager [None req-eda80d20-65be-4700-b321-638827849abc None None] Determined volume DB was empty at startup. Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG cinder.volume.manager [None req-eda80d20-65be-4700-b321-638827849abc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87264) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:26:54 devstack cinder-volume[87264]: INFO cinder.volume.manager [None req-eda80d20-65be-4700-b321-638827849abc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 16:26:54 devstack cinder-volume[87264]: WARNING stevedore.named [None req-eda80d20-65be-4700-b321-638827849abc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:26:54 devstack cinder-volume[87264]: WARNING castellan.key_manager [None req-eda80d20-65be-4700-b321-638827849abc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:26:54 devstack cinder-volume[87264]: WARNING cinder.keymgr.conf_key_mgr [None req-eda80d20-65be-4700-b321-638827849abc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:26:54 devstack cinder-volume[87264]: INFO cinder.volume.manager [None req-eda80d20-65be-4700-b321-638827849abc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_db.sqlalchemy.engines [None req-eda80d20-65be-4700-b321-638827849abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:26:54 devstack cinder-volume[87264]: INFO oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Starting 1 workers Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Started child 87477 {{(pid=87264) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Full set of CONF: {{(pid=87264) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] ******************************************************************************** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Configuration options gathered from: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] ================================================================================ {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] allow_availability_zone_fallback = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] allow_compression_on_image_upload = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] allowed_direct_url_schemes = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] api_rate_limit = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] auth_strategy = keystone {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_availability_zone = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87477]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_host = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_stats_polling_interval = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backup_api_class = cinder.backup.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backup_name_template = backup-%s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backup_use_same_host = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backup_use_temp_snapshot = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] chap_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] chap_username = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_internal_tenant_project_id = 4666f887bdb146ef856a026f690a8a43 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_internal_tenant_user_id = 7d77ded8eed142ceb318669c6cb601af {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cluster = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] compression_format = gzip {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] compute_api_class = cinder.compute.nova.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] config_dir = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] config_source = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] control_exchange = openstack {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] debug = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] default_availability_zone = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] default_group_type = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] default_volume_type = QuobyteHD {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] disk_geometry = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] driver_client_cert = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] driver_client_cert_key = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] driver_data_namespace = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] driver_ssl_cert_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] driver_ssl_cert_verify = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] driver_use_ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] enable_new_services = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] enable_unsupported_driver = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] enabled_backends = ['QuobyteHD'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] enforce_multipath_for_image_xfer = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] filter_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_api_insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_api_servers = ['http://192.168.122.12/image'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_api_ssl_compression = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_ca_certificates_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_catalog_info = image:glance:publicURL {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_num_retries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance_request_timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] goodness_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] graceful_shutdown_timeout = 5 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] group_api_class = cinder.group.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] host = devstack {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_compress_on_upload = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_conversion_address_space_limit = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_conversion_cpu_limit = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_conversion_disable = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_upload_use_cinder_backend = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_upload_use_internal_tenant = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_volume_cache_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_volume_cache_max_count = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] image_volume_cache_max_size_gb = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] init_host_max_objects_retrieval = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] instance_format = [instance: %(uuid)s] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] iscsi_target_flags = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] iscsi_write_cache = on {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] iser_helper = tgtadm {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] iser_ip_address = 192.168.122.12 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] iser_port = 3260 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_color = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_config_append = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_dir = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87477]: INFO cinder.volume.manager [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Starting volume driver QuobyteDriver (1.2) Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.remotefs [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87477) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_options = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_rotate_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_rotate_interval_type = days {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] log_rotation_type = none {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] max_age = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] max_logfile_count = 30 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] max_logfile_size_mb = 200 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] max_over_subscription_ratio = 20.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] message_reap_interval = 86400 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] message_ttl = 2592000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] migration_create_volume_timeout_secs = 300 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] monkey_patch = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] monkey_patch_modules = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] my_ip = 192.168.122.12 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] no_snapshot_gb_quota = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] num_iser_scan_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] num_shell_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] num_volume_device_scan_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] nvmeof_conn_info_version = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] nvmet_ns_id = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] nvmet_port_id = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] osapi_max_limit = 1000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] osapi_volume_ext_list = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] osapi_volume_listen = 0.0.0.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] osapi_volume_listen_port = 8776 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] osapi_volume_use_ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] osapi_volume_workers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] per_volume_size_limit = -1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] periodic_fuzzy_delay = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] periodic_interval = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] project_id_regex = [0-9a-f\-]+ {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] public_endpoint = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] publish_errors = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] quota_backup_gigabytes = 1000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] quota_backups = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] quota_gigabytes = 1000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] quota_groups = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] quota_snapshots = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] quota_volumes = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] rate_limit_burst = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] rate_limit_except_level = CRITICAL {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] rate_limit_interval = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] reinit_driver_count = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] replication_device = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] report_discard_supported = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] report_interval = 120 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] reservation_clean_interval = 86400 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] reservation_expire = 86400 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] reserved_image_namespaces = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] reserved_percentage = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] rpc_response_timeout = 120 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] run_external_periodic_tasks = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] scst_target_driver = iscsi {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] scst_target_iqn_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_down_time = 720 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] shell_completion = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] snapshot_name_template = snapshot-%s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] state_path = /opt/stack/data/cinder {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] storage_availability_zone = nova {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] storage_protocol = iSCSI {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] syslog_log_facility = LOG_USER {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] target_helper = lioadm {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] target_ip_address = 192.168.122.12 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] target_port = 3260 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] target_protocol = iscsi {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] target_secondary_ip_addresses = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] trace_flags = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] transfer_api_class = cinder.transfer.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] transport_url = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] until_refresh = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] use_chap_auth = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] use_default_quota_class = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] use_journal = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] use_json = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] use_multipath_for_image_xfer = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] use_stderr = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] use_syslog = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] verify_glance_signatures = enabled {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_api_class = cinder.volume.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_backend_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_clear = zero {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_clear_ionice = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_clear_size = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_copy_bps_limit = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_dd_blocksize = 1M {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_name_template = volume-%s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_service_inithost_offload = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volume_usage_audit_period = month {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] zoning_mode = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_concurrency.disable_process_locking = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.auth_section = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.auth_type = password {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.auth_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.cache = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.delay_auth_decision = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.http_connect_timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.include_service_catalog = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.interface = public {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_password = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcache_username = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.region_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87477) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 30 16:26:54 devstack cinder-volume[87477]: WARNING cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 30 16:26:54 devstack cinder-volume[87477]: WARNING cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.service_token_roles_required = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.service_type = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.token_cache_time = 300 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.12/identity {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.backend = dogpile.cache.null {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.backend_argument = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Running cmd (subprocess): mount.quobyte {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.backend_expiration_time = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.config_prefix = cache.oslo {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.debug_cache_backend = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.enable_retry_client = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.enable_socket_keepalive = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.expiration_time = 600 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.hashclient_retry_attempts = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.memcache_dead_retry = 300 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.memcache_pool_maxsize = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.memcache_sasl_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.proxies = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.redis_db = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.redis_sentinel_service_name = mymaster {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.redis_server = localhost:6379 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.retry_attempts = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.retry_delay = 0.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.socket_keepalive_count = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.socket_keepalive_idle = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.socket_keepalive_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.socket_timeout = 1.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.tls_allowed_ciphers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.tls_cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.tls_certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.tls_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.tls_keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cache.username = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] coordination.backend_url = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.asyncio_connection = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.asyncio_slave_connection = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.backend = sqlalchemy {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.connection = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.connection_debug = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.connection_parameters = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.connection_recycle_time = 3600 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.connection_trace = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.db_inc_retry_interval = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.db_max_retries = 20 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.db_max_retry_interval = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.db_retry_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.max_overflow = 50 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.max_pool_size = 5 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.max_retries = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.mysql_wsrep_sync_wait = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.pool_timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.retry_interval = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.slave_connection = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.sqlite_synchronous = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.synchronous_reader = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] database.use_db_reconnect = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.connection_string = messaging:// {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.es_doc_type = notification {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.es_scroll_size = 10000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.es_scroll_time = 2m {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.filter_error_trace = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.hmac_keys = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.sentinel_service_name = mymaster {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.socket_timeout = 0.1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.trace_requests = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler.trace_sqlalchemy = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler_jaeger.process_tags = {} {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler_jaeger.service_name_prefix = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] profiler_otlp.service_name_prefix = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.enforce_new_defaults = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.policy_default_rule = default {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.policy_file = policy.yaml {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_policy.remote_timeout = 60.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] privsep_osbrick.group = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] privsep_osbrick.helper_command = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] privsep_osbrick.user = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_sys_admin.group = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_sys_admin.helper_command = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] cinder_sys_admin.user = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.auth_section = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.auth_type = password {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack quobyte-client[87480]: Reading configuration file: /etc/quobyte/client.cfg Jul 30 16:26:54 devstack quobyte-client[87480]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.collect_timing = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.send_service_user_token = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] service_user.timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.auth_section = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] CMD "mount.quobyte" returned: 1 in 0.100s {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:54 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.auth_type = password {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=87477) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.collect_timing = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.region_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87477]: INFO cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 ... Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] glance.timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.backend_availability_zone = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf -c /etc/quobyte/client-cinder.cfg {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.chap_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.chap_username = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.disk_geometry = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.driver_client_cert = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.driver_client_cert_key = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.driver_data_namespace = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.driver_use_ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.enable_unsupported_driver = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.extra_capabilities = {} {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.filter_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.goodness_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.iscsi_target_flags = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.iscsi_write_cache = on {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.iser_helper = tgtadm {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.iser_ip_address = 192.168.122.12 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.iser_port = 3260 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_host = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_login = admin {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_mount_options = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_private_key = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_share_path = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_ssh_port = 22 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf -c /etc/quobyte/client-cinder.cfg Jul 30 16:26:54 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.num_shell_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.nvmet_port_id = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.quobyte_client_cfg = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.quobyte_volume_url = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.replication_device = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.report_discard_supported = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.reserved_percentage = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.scst_target_driver = iscsi {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.scst_target_iqn_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.storage_protocol = iSCSI {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.target_helper = tgtadm {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.target_ip_address = 192.168.122.12 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.target_port = 3260 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.target_protocol = iscsi {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.trace_flags = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.unique_fqdn_network = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.use_chap_auth = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volume_backend_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volume_clear = zero {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volume_clear_ionice = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volume_clear_size = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_reports.file_event_handler = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_reports.log_dir = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.backend_availability_zone = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.backend_host = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.chap_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.chap_username = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.chiscsi_conf = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.disk_geometry = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.driver_client_cert = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.driver_client_cert_key = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.driver_data_namespace = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.driver_use_ssl = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:54 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.extra_capabilities = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.filter_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.goodness_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.iscsi_target_flags = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.iscsi_write_cache = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.iser_helper = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.iser_ip_address = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.iser_port = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.iser_target_prefix = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_host = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_login = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_mount_options = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_private_key = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_share_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_ssh_port = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.num_shell_tries = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nvmet_ns_id = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.nvmet_port_id = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.replication_device = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.report_discard_supported = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.reserved_percentage = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.scst_target_driver = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.storage_protocol = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.target_helper = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.target_ip_address = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.target_port = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.target_prefix = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.target_protocol = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.trace_flags = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.unique_fqdn_network = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.use_chap_auth = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volume_clear = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volume_clear_ionice = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volume_clear_size = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] QuobyteHD.volumes_dir = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.ssl_version = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_notifications.driver = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_notifications.retry = -1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] oslo_messaging_notifications.transport_url = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] key_manager.fixed_key = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.barbican_api_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.barbican_endpoint = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.barbican_endpoint_type = public {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.barbican_region_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.collect_timing = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.number_of_retries = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.retry_delay = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.send_service_user_token = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.verify_ssl = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican.verify_ssl_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.auth_section = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.auth_type = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.collect_timing = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] barbican_service_user.timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.approle_role_id = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.approle_secret_id = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.auth_method = approle {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.auth_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.kv_mountpoint = secret {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.kv_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.kv_version = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.namespace = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.root_token_id = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.ssl_ca_crt_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.timeout = 60.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.token_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.token_role = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.use_ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:26:55 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] ******************************************************************************** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:26:55 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Jul 30 16:26:55 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.597s {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:55 devstack cinder-volume[87477]: INFO cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 succeeded Jul 30 16:26:55 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=87477) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:26:55 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.615s {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:26:55 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:55 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:26:55 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:26:55 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Jul 30 16:26:55 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.409s {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:55 devstack cinder-volume[87477]: INFO cinder.volume.driver [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:26:55 devstack cinder-volume[87477]: DEBUG cinder.volume.driver [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576942443848, 'free_capacity_gb': 1775.7576942443848, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87477) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG oslo_db.sqlalchemy.engines [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87477) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG dbcounter [-] [87477] Writer thread running {{(pid=87477) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG cinder.db.api [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Building query based on filter {{(pid=87477) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG cinder.image.image_utils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87477) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:26:56 devstack cinder-volume[87477]: INFO cinder.keymgr.migration [None req-0400f313-36ac-45ad-91e8-5c3a95c7c1ce None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=87477) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=87477) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:56 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:26:56 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:26:56 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.388s {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG cinder.manager [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Notifying Schedulers of capabilities ... {{(pid=87477) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:26:56 devstack cinder-volume[87477]: INFO cinder.volume.manager [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Driver initialization completed successfully. Jul 30 16:26:56 devstack cinder-volume[87477]: INFO cinder.manager [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Initiating service 3 cleanup Jul 30 16:26:56 devstack cinder-volume[87477]: INFO cinder.manager [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Service 3 cleanup completed. Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG cinder.service [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Creating RPC server for service cinder-volume {{(pid=87477) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:26:56 devstack cinder-volume[87477]: DEBUG cinder.service [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87477) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:26:57 devstack cinder-volume[87477]: INFO cinder.volume.manager [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 30 16:26:57 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:26:57 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:26:57 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=87477) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:26:57 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=87477) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:26:57 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:26:57 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:26:57 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:26:57 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:26:57 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Jul 30 16:26:57 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.372s {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:26:57 devstack cinder-volume[87477]: INFO cinder.volume.manager [None req-097d653b-a70a-430e-a73d-c9dee3bcff15 None None] Driver post RPC initialization completed successfully. Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-db8b8736-8520-4c20-b0b2-3d1fc8a224a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-db8b8736-8520-4c20-b0b2-3d1fc8a224a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-db8b8736-8520-4c20-b0b2-3d1fc8a224a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=87477) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG cinder.volume.drivers.quobyte [None req-db8b8736-8520-4c20-b0b2-3d1fc8a224a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=87477) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-db8b8736-8520-4c20-b0b2-3d1fc8a224a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87477) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-db8b8736-8520-4c20-b0b2-3d1fc8a224a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:27:00 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:27:00 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:27:00 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG oslo_concurrency.processutils [None req-db8b8736-8520-4c20-b0b2-3d1fc8a224a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.219s {{(pid=87477) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG cinder.manager [None req-db8b8736-8520-4c20-b0b2-3d1fc8a224a6 None None] Notifying Schedulers of capabilities ... {{(pid=87477) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG oslo_service.periodic_task [None req-c4cf8d5c-25b9-4d46-8476-1aceb22e72e8 None None] Running periodic task VolumeManager._thread_info {{(pid=87477) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG cinder.volume.manager [None req-c4cf8d5c-25b9-4d46-8476-1aceb22e72e8 None None] thread count: 6 {{(pid=87477) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:27:00 devstack cinder-volume[87477]: DEBUG cinder.volume.manager [None req-c4cf8d5c-25b9-4d46-8476-1aceb22e72e8 None None] thread info: [<_MainThread(MainThread, started 129700979323008)>, , , , , ] {{(pid=87477) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:27:01 devstack cinder-volume[87264]: INFO oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Caught SIGTERM, stopping children Jul 30 16:27:01 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [None req-eda80d20-65be-4700-b321-638827849abc None None] Acquiring lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:27:01 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [None req-eda80d20-65be-4700-b321-638827849abc None None] Acquired lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:27:01 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [None req-eda80d20-65be-4700-b321-638827849abc None None] Releasing lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:27:01 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Stop services. {{(pid=87264) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 30 16:27:01 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Killing children. {{(pid=87264) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 30 16:27:01 devstack cinder-volume[87264]: INFO oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Waiting on 1 children to exit Jul 30 16:27:05 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-eda80d20-65be-4700-b321-638827849abc None None] Acquiring lock "singleton_lock" {{(pid=87477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:27:05 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-eda80d20-65be-4700-b321-638827849abc None None] Acquired lock "singleton_lock" {{(pid=87477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:27:05 devstack cinder-volume[87477]: DEBUG oslo_concurrency.lockutils [None req-eda80d20-65be-4700-b321-638827849abc None None] Releasing lock "singleton_lock" {{(pid=87477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:27:05 devstack cinder-volume[87477]: WARNING amqp [None req-eda80d20-65be-4700-b321-638827849abc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:27:05 devstack cinder-volume[87264]: INFO oslo_service.backend._eventlet.service [None req-eda80d20-65be-4700-b321-638827849abc None None] Child 87477 exited with status 0 Jul 30 16:27:05 devstack cinder-volume[87795]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:27:05 devstack cinder-volume[87795]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:27:05 devstack cinder-volume[87795]: we strongly recommend against using it for new projects. Jul 30 16:27:05 devstack cinder-volume[87795]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:27:05 devstack cinder-volume[87795]: framework. For more detail see Jul 30 16:27:05 devstack cinder-volume[87795]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:27:05 devstack cinder-volume[87795]: import eventlet # noqa Jul 30 16:27:08 devstack cinder-volume[87795]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:27:08 devstack cinder-volume[87795]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:27:08 devstack cinder-volume[87795]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87795) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:27:09 devstack cinder-volume[87795]: INFO dbcounter [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Registered counter for database cinder Jul 30 16:27:09 devstack cinder-volume[87795]: DEBUG oslo_db.sqlalchemy.engines [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87795) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:27:09 devstack cinder-volume[87795]: DEBUG dbcounter [-] [87795] Writer thread running {{(pid=87795) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:27:09 devstack cinder-volume[87795]: INFO cinder.rpc [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:27:09 devstack cinder-volume[87795]: INFO cinder.rpc [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:27:09 devstack cinder-volume[87795]: DEBUG oslo_db.sqlalchemy.engines [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87795) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:27:10 devstack cinder-volume[87795]: INFO cinder.volume.manager [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Determined volume DB was empty at startup. Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG cinder.volume.manager [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87795) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:27:10 devstack cinder-volume[87795]: WARNING stevedore.named [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:27:10 devstack cinder-volume[87795]: WARNING castellan.key_manager [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:27:10 devstack cinder-volume[87795]: WARNING cinder.keymgr.conf_key_mgr [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:27:10 devstack cinder-volume[87795]: INFO cinder.volume.manager [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_db.sqlalchemy.engines [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87795) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:27:10 devstack cinder-volume[87795]: INFO oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Starting 1 workers Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Started child 88095 {{(pid=87795) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Full set of CONF: {{(pid=87795) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] ******************************************************************************** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] Configuration options gathered from: {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] ================================================================================ {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:27:10 devstack cinder-volume[88095]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] allow_availability_zone_fallback = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] allow_compression_on_image_upload = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] allowed_direct_url_schemes = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] api_rate_limit = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] auth_strategy = keystone {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_availability_zone = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_host = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_stats_polling_interval = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backup_api_class = cinder.backup.api.API {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backup_name_template = backup-%s {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backup_use_same_host = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backup_use_temp_snapshot = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] chap_password = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] chap_username = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_internal_tenant_project_id = 4666f887bdb146ef856a026f690a8a43 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_internal_tenant_user_id = 7d77ded8eed142ceb318669c6cb601af {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cluster = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] compression_format = gzip {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] compute_api_class = cinder.compute.nova.API {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] config_dir = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] config_source = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] control_exchange = openstack {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] debug = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] default_availability_zone = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] default_group_type = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] default_volume_type = QuobyteHD {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] disk_geometry = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] driver_client_cert = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] driver_client_cert_key = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] driver_data_namespace = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] driver_ssl_cert_path = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] driver_ssl_cert_verify = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] driver_use_ssl = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] enable_new_services = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] enable_unsupported_driver = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] enabled_backends = ['QuobyteHD'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] enforce_multipath_for_image_xfer = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] filter_function = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_api_insecure = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_api_servers = ['http://192.168.122.12/image'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_api_ssl_compression = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_ca_certificates_file = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_catalog_info = image:glance:publicURL {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_certfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_keyfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_num_retries = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance_request_timeout = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] goodness_function = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] graceful_shutdown_timeout = 5 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] group_api_class = cinder.group.api.API {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] host = devstack {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_compress_on_upload = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_conversion_address_space_limit = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_conversion_cpu_limit = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_conversion_disable = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_upload_use_cinder_backend = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_upload_use_internal_tenant = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_volume_cache_enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_volume_cache_max_count = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] image_volume_cache_max_size_gb = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] init_host_max_objects_retrieval = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] instance_format = [instance: %(uuid)s] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] iscsi_target_flags = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] iscsi_write_cache = on {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] iser_helper = tgtadm {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] iser_ip_address = 192.168.122.12 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] iser_port = 3260 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_color = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_config_append = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_dir = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_file = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_options = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_rotate_interval = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_rotate_interval_type = days {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] log_rotation_type = none {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Starting volume driver QuobyteDriver (1.2) Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] max_age = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88095) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] max_logfile_count = 30 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] max_logfile_size_mb = 200 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] max_over_subscription_ratio = 20.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] message_reap_interval = 86400 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] message_ttl = 2592000 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] migration_create_volume_timeout_secs = 300 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] monkey_patch = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] monkey_patch_modules = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] my_ip = 192.168.122.12 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] no_snapshot_gb_quota = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] num_iser_scan_tries = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] num_shell_tries = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] num_volume_device_scan_tries = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] nvmeof_conn_info_version = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] nvmet_ns_id = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] nvmet_port_id = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] osapi_max_limit = 1000 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] osapi_volume_ext_list = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] osapi_volume_listen_port = 8776 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] osapi_volume_use_ssl = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] osapi_volume_workers = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] per_volume_size_limit = -1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] periodic_fuzzy_delay = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] periodic_interval = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] public_endpoint = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] publish_errors = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] quota_backup_gigabytes = 1000 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] quota_backups = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] quota_gigabytes = 1000 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] quota_groups = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] quota_snapshots = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] quota_volumes = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] rate_limit_burst = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] rate_limit_except_level = CRITICAL {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] rate_limit_interval = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] reinit_driver_count = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] replication_device = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] report_discard_supported = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] report_interval = 120 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] reservation_clean_interval = 86400 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] reservation_expire = 86400 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] reserved_image_namespaces = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] reserved_percentage = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] rpc_response_timeout = 120 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] run_external_periodic_tasks = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] scst_target_driver = iscsi {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] scst_target_iqn_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_down_time = 720 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] shell_completion = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] snapshot_name_template = snapshot-%s {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] split_loggers = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] state_path = /opt/stack/data/cinder {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] storage_availability_zone = nova {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] storage_protocol = iSCSI {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] syslog_log_facility = LOG_USER {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] target_helper = lioadm {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] target_ip_address = 192.168.122.12 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] target_port = 3260 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] target_protocol = iscsi {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] target_secondary_ip_addresses = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] trace_flags = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] transport_url = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] until_refresh = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] use_chap_auth = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] use_default_quota_class = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] use_journal = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] use_json = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] use_multipath_for_image_xfer = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] use_stderr = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] use_syslog = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] verify_glance_signatures = enabled {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_api_class = cinder.volume.api.API {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_backend_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_clear = zero {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_clear_ionice = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_clear_size = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_copy_bps_limit = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_dd_blocksize = 1M {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_name_template = volume-%s {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_service_inithost_offload = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volume_usage_audit_period = month {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] zoning_mode = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_concurrency.disable_process_locking = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.auth_section = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.auth_type = password {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.auth_version = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.cache = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.certfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.include_service_catalog = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.insecure = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.interface = public {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.keyfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_password = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcache_username = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.region_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.service_type = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.12/identity {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.backend = dogpile.cache.null {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.backend_argument = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.backend_expiration_time = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.config_prefix = cache.oslo {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.debug_cache_backend = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.enable_retry_client = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.enable_socket_keepalive = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.expiration_time = 600 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.hashclient_retry_attempts = 2 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.memcache_dead_retry = 300 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.memcache_pool_maxsize = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.memcache_sasl_enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.password = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.proxies = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.redis_db = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.redis_server = localhost:6379 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.retry_attempts = 2 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.retry_delay = 0.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.socket_keepalive_count = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.socket_keepalive_idle = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88095) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.socket_keepalive_interval = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 30 16:27:10 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.socket_timeout = 1.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.tls_allowed_ciphers = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.tls_cafile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.tls_certfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.tls_enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Running cmd (subprocess): mount.quobyte {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.tls_keyfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cache.username = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] coordination.backend_url = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.asyncio_connection = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.asyncio_slave_connection = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.backend = sqlalchemy {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.connection = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.connection_debug = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.connection_parameters = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.connection_recycle_time = 3600 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.connection_trace = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.db_inc_retry_interval = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.db_max_retries = 20 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.db_max_retry_interval = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.db_retry_interval = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.max_overflow = 50 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.max_pool_size = 5 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.max_retries = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.mysql_wsrep_sync_wait = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.pool_timeout = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.retry_interval = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.slave_connection = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.sqlite_synchronous = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.synchronous_reader = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] database.use_db_reconnect = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.connection_string = messaging:// {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.es_doc_type = notification {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.es_scroll_size = 10000 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.es_scroll_time = 2m {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.filter_error_trace = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.hmac_keys = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.sentinel_service_name = mymaster {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.socket_timeout = 0.1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.trace_requests = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler.trace_sqlalchemy = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler_jaeger.process_tags = {} {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler_jaeger.service_name_prefix = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] profiler_otlp.service_name_prefix = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.enforce_new_defaults = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.policy_default_rule = default {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.policy_file = policy.yaml {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] privsep_osbrick.group = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] privsep_osbrick.helper_command = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] privsep_osbrick.user = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_sys_admin.group = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_sys_admin.helper_command = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] cinder_sys_admin.user = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.auth_section = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.auth_type = password {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.cafile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.certfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.collect_timing = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.insecure = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.keyfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.send_service_user_token = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.split_loggers = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] service_user.timeout = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.auth_section = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.auth_type = password {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.certfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.collect_timing = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.insecure = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.keyfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.region_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.split_loggers = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] glance.timeout = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.backend_availability_zone = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.chap_password = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.chap_username = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.disk_geometry = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.driver_client_cert = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.driver_client_cert_key = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.driver_data_namespace = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.driver_use_ssl = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.extra_capabilities = {} {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.filter_function = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.goodness_function = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.iscsi_target_flags = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.iscsi_write_cache = on {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.iser_helper = tgtadm {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.iser_ip_address = 192.168.122.12 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.iser_port = 3260 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack quobyte-client[88096]: Reading configuration file: /etc/quobyte/client.cfg Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_host = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_login = admin {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack quobyte-client[88096]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_mount_options = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_password = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_private_key = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_share_path = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.num_shell_tries = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.quobyte_volume_url = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.replication_device = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.report_discard_supported = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.reserved_percentage = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.target_helper = tgtadm {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.target_ip_address = 192.168.122.12 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.target_port = 3260 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.target_protocol = iscsi {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.trace_flags = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.unique_fqdn_network = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.use_chap_auth = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volume_backend_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volume_clear = zero {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volume_clear_ionice = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volume_clear_size = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_reports.file_event_handler = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_reports.log_dir = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.backend_availability_zone = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.backend_host = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.chap_password = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.chap_username = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.chiscsi_conf = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.disk_geometry = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.driver_client_cert = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.driver_data_namespace = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.driver_use_ssl = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.extra_capabilities = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.filter_function = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.goodness_function = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.iser_helper = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.iser_ip_address = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.iser_port = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.iser_target_prefix = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_host = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_login = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_mount_options = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_password = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_private_key = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_share_path = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_ssh_port = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.num_shell_tries = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.nvmet_port_id = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.replication_device = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.report_discard_supported = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.reserved_percentage = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.scst_target_driver = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.storage_protocol = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.target_helper = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.target_ip_address = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.target_port = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.target_prefix = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.target_protocol = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.trace_flags = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.use_chap_auth = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volume_clear = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volume_clear_size = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] QuobyteHD.volumes_dir = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.ssl = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_notifications.driver = [] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_notifications.retry = -1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] key_manager.fixed_key = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.barbican_api_version = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.barbican_endpoint = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.barbican_endpoint_type = public {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.barbican_region_name = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.cafile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.certfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.collect_timing = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.insecure = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.keyfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.number_of_retries = 60 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.retry_delay = 1 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.send_service_user_token = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.split_loggers = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.timeout = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.verify_ssl = True {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican.verify_ssl_path = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.auth_section = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.auth_type = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.cafile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.certfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.collect_timing = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.insecure = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.keyfile = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.split_loggers = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] barbican_service_user.timeout = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.approle_role_id = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.approle_secret_id = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.auth_method = approle {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.auth_path = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.kv_mountpoint = secret {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.kv_path = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.kv_version = 2 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.namespace = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.root_token_id = **** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.ssl_ca_crt_file = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.timeout = 60.0 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.token_file = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.token_role = None {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.use_ssl = False {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:27:10 devstack cinder-volume[87795]: DEBUG oslo_service.backend._eventlet.service [None req-b9b218df-0a25-4496-8a6d-ad3ffaeb45a3 None None] ******************************************************************************** {{(pid=87795) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:27:10 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.255s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:27:10 devstack cinder-volume[88095]: INFO cinder.volume.driver [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.volume.driver [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576942443848, 'free_capacity_gb': 1775.7576942443848, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88095) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_db.sqlalchemy.engines [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writer thread running {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.db.api [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Building query based on filter {{(pid=88095) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88095) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:27:10 devstack cinder-volume[88095]: INFO cinder.keymgr.migration [None req-2449b992-f48a-4ff7-8ef7-a34efca91284 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:27:10 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:27:10 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:27:10 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.240s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:27:10 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:27:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Driver initialization completed successfully. Jul 30 16:27:10 devstack cinder-volume[88095]: INFO cinder.manager [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Initiating service 3 cleanup Jul 30 16:27:11 devstack cinder-volume[88095]: INFO cinder.manager [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Service 3 cleanup completed. Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG cinder.service [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Creating RPC server for service cinder-volume {{(pid=88095) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG cinder.service [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88095) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:27:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:27:11 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:27:11 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:27:11 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Jul 30 16:27:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.236s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:27:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-62ee890f-51e1-4229-9da6-cf697c5fee42 None None] Driver post RPC initialization completed successfully. Jul 30 16:27:20 devstack cinder-volume[87795]: DEBUG dbcounter [-] [87795] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87795) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:27:20 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:27:21 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:27:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:27:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 6 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:27:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:28:27 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Flow 'volume_create_manager' (d4a79c64-9234-42e2-915d-16591224489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0c69de-c0f7-433b-b2c5-e047d23f590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0c69de-c0f7-433b-b2c5-e047d23f590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1440599240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da51f4b6-2b02-4d35-acd3-8338ab06622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f49d27f17e48f8ba026a2cf8430724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:28:28Z,use_quota=True,user_id='751bd2f35bd64fb79971e648a0ad2e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b85bd9-de36-4a76-ba9c-b333ae8f2db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b85bd9-de36-4a76-ba9c-b333ae8f2db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1d602d-83ec-4307-baf0-59497039f5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1d602d-83ec-4307-baf0-59497039f5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da51f4b6-2b02-4d35-acd3-8338ab06622d', 'volume_name': 'volume-da51f4b6-2b02-4d35-acd3-8338ab06622d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3645910b-a3dc-4ed1-87b7-187c480017ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3645910b-a3dc-4ed1-87b7-187c480017ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18e924a-f5b5-4a99-8ec7-d843df871bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Volume da51f4b6-2b02-4d35-acd3-8338ab06622d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da51f4b6-2b02-4d35-acd3-8338ab06622d', 'volume_size': 1} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1440599240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da51f4b6-2b02-4d35-acd3-8338ab06622d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f49d27f17e48f8ba026a2cf8430724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:28:28Z,use_quota=True,user_id='751bd2f35bd64fb79971e648a0ad2e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Creating volume da51f4b6-2b02-4d35-acd3-8338ab06622d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:28:28 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:28:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:28 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d 1073741824 Jul 30 16:28:28 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:30 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d 1073741824" returned: 0 in 1.826s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:30 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d Jul 30 16:28:30 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:31 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d" returned: 0 in 0.723s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] <== create_volume: return (2649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:28:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.652s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18e924a-f5b5-4a99-8ec7-d843df871bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da51f4b6-2b02-4d35-acd3-8338ab06622d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f9bd81-ba13-4363-83f0-7aac241d8233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Volume volume-da51f4b6-2b02-4d35-acd3-8338ab06622d (da51f4b6-2b02-4d35-acd3-8338ab06622d): created successfully Jul 30 16:28:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f9bd81-ba13-4363-83f0-7aac241d8233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Flow 'volume_create_manager' (d4a79c64-9234-42e2-915d-16591224489b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:28:31 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5d9f6da2-cde6-4a86-a390-2ca6e04b659c tempest-DeleteServersTestJSON-1022258091 None] Created volume successfully. Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Flow 'volume_create_manager' (2d8c3ca1-fe9d-4e34-a0f7-835c0cf8d385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770d6703-e3bd-41ce-b937-bc18680df793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770d6703-e3bd-41ce-b937-bc18680df793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-338079808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae737e5-5529-43f8-975b-eb49d62fcf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5b6c16240448a8a8ba1cf2393c4798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:28:34Z,use_quota=True,user_id='697726b90e084663af2e350573ed54c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b11f84b-1341-4859-be86-0a3f20f5494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b11f84b-1341-4859-be86-0a3f20f5494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88e119f-4598-4a06-8080-f5e2ef62b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88e119f-4598-4a06-8080-f5e2ef62b912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae737e5-5529-43f8-975b-eb49d62fcf0a', 'volume_name': 'volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f35e3d-0a72-40a7-9f43-ea7fda831619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f35e3d-0a72-40a7-9f43-ea7fda831619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401a3bc7-7d0a-459e-866d-7e91b99f92ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:34 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Volume 6ae737e5-5529-43f8-975b-eb49d62fcf0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a', 'volume_size': 1} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-338079808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae737e5-5529-43f8-975b-eb49d62fcf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d5b6c16240448a8a8ba1cf2393c4798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:28:34Z,use_quota=True,user_id='697726b90e084663af2e350573ed54c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Creating volume 6ae737e5-5529-43f8-975b-eb49d62fcf0a {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:28:34 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:28:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:34 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a 1073741824 Jul 30 16:28:34 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:35 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a 1073741824" returned: 0 in 1.094s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:35 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a Jul 30 16:28:35 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:36 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a" returned: 0 in 0.585s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:28:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401a3bc7-7d0a-459e-866d-7e91b99f92ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d53dba-6928-4245-8b75-6db12ff683e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:36 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Volume volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a (6ae737e5-5529-43f8-975b-eb49d62fcf0a): created successfully Jul 30 16:28:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d53dba-6928-4245-8b75-6db12ff683e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Flow 'volume_create_manager' (2d8c3ca1-fe9d-4e34-a0f7-835c0cf8d385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:28:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a3e23bad-5d65-45aa-bed6-cc5b36385c83 tempest-VolumesAdminNegativeTest-1554910429 None] Created volume successfully. Jul 30 16:28:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Acquiring lock "cinder-6ae737e5-5529-43f8-975b-eb49d62fcf0a-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:28:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "cinder-6ae737e5-5529-43f8-975b-eb49d62fcf0a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:28:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Acquiring lock "cinder-quobyte-6ae737e5-5529-43f8-975b-eb49d62fcf0a" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:28:39 devstack cinder-volume[88095]: WARNING py.warnings [req-7a6afffb-4d59-4fa8-a1df-39185cd72f65 req-0ac3d41f-a623-4c71-b7e1-744c6da9d32c tempest-DeleteServersTestJSON-1022258091 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 30 16:28:39 devstack cinder-volume[88095]: .first() Jul 30 16:28:39 devstack cinder-volume[88095]: Jul 30 16:28:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "cinder-quobyte-6ae737e5-5529-43f8-975b-eb49d62fcf0a" acquired by "delete_volume" :: waited 0.191s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:28:39 devstack cinder-volume[88095]: INFO oslo.privsep.daemon [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp07dxejr_/privsep.sock'] Jul 30 16:28:39 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp07dxejr_/privsep.sock Jul 30 16:28:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7a6afffb-4d59-4fa8-a1df-39185cd72f65 req-0ac3d41f-a623-4c71-b7e1-744c6da9d32c tempest-DeleteServersTestJSON-1022258091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7a6afffb-4d59-4fa8-a1df-39185cd72f65 req-0ac3d41f-a623-4c71-b7e1-744c6da9d32c tempest-DeleteServersTestJSON-1022258091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:39 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7a6afffb-4d59-4fa8-a1df-39185cd72f65 req-0ac3d41f-a623-4c71-b7e1-744c6da9d32c tempest-DeleteServersTestJSON-1022258091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-7a6afffb-4d59-4fa8-a1df-39185cd72f65 req-0ac3d41f-a623-4c71-b7e1-744c6da9d32c tempest-DeleteServersTestJSON-1022258091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-da51f4b6-2b02-4d35-acd3-8338ab06622d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2eabf1ed-ba0d-484e-9296-aa21d16d3cbb', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:28:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-7a6afffb-4d59-4fa8-a1df-39185cd72f65 req-0ac3d41f-a623-4c71-b7e1-744c6da9d32c tempest-DeleteServersTestJSON-1022258091 None] attachment_update completed successfully. Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Flow 'volume_create_manager' (a4f1d82b-ad1b-491f-9ef8-2cc69f96be45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4e0eee-1312-4267-a763-67c2dc7aa7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4e0eee-1312-4267-a763-67c2dc7aa7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-897687316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584d3697-bceb-4cd0-ab34-968c9eac5f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91590d4a2464b3c837fa4b8b2197e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:28:41Z,use_quota=True,user_id='384cf4c028274fb1ba3da7f6daf2a038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bdbe658-0918-415e-b9fd-b2a5baad94cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bdbe658-0918-415e-b9fd-b2a5baad94cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27234f8-9812-4d9f-8f11-edbe643eed73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27234f8-9812-4d9f-8f11-edbe643eed73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '584d3697-bceb-4cd0-ab34-968c9eac5f29', 'volume_name': 'volume-584d3697-bceb-4cd0-ab34-968c9eac5f29', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021fcf9e-e885-4d9b-acfe-8890454d0e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021fcf9e-e885-4d9b-acfe-8890454d0e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc71bcd0-10f9-47eb-bfe1-84870851b296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Volume 584d3697-bceb-4cd0-ab34-968c9eac5f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-584d3697-bceb-4cd0-ab34-968c9eac5f29', 'volume_size': 1} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-897687316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584d3697-bceb-4cd0-ab34-968c9eac5f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91590d4a2464b3c837fa4b8b2197e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:28:41Z,use_quota=True,user_id='384cf4c028274fb1ba3da7f6daf2a038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Creating volume 584d3697-bceb-4cd0-ab34-968c9eac5f29 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:28:41 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:28:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: Jul 30 16:28:41 devstack cinder-volume[88095]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 30 16:28:41 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 1073741824 Jul 30 16:28:41 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:42 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:42 devstack cinder-volume[88095]: INFO oslo.privsep.daemon [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Spawned new privsep daemon via rootwrap Jul 30 16:28:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Accepted privsep connection to /tmp/tmp07dxejr_/privsep.sock {{(pid=88095) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 30 16:28:42 devstack cinder-volume[88095]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 30 16:28:42 devstack cinder-volume[88095]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 30 16:28:42 devstack cinder-volume[88095]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 30 16:28:42 devstack cinder-volume[88095]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89835 Jul 30 16:28:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a73cd2-c6a4-42eb-9986-8666e48b87ba]: (2,) {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:28:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1edcc2a-00ff-4b1f-bee5-7fd70072962b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:28:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:42 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a Jul 30 16:28:42 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:43 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 1073741824" returned: 0 in 1.468s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:43 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 Jul 30 16:28:43 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:43 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a" returned: 0 in 1.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:43 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a Jul 30 16:28:43 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:43 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29" returned: 0 in 0.631s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc71bcd0-10f9-47eb-bfe1-84870851b296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584d3697-bceb-4cd0-ab34-968c9eac5f29', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96b8958-b0dc-4dac-8797-4d0a721318cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:44 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Volume volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 (584d3697-bceb-4cd0-ab34-968c9eac5f29): created successfully Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96b8958-b0dc-4dac-8797-4d0a721318cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Flow 'volume_create_manager' (a4f1d82b-ad1b-491f-9ef8-2cc69f96be45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:28:44 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f3ee858a-4319-45a6-95dc-b5869fd924bc tempest-ServerRescueNegativeTestJSON-1385789633 None] Created volume successfully. Jul 30 16:28:44 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ae737e5-5529-43f8-975b-eb49d62fcf0a" returned: 0 in 0.802s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "cinder-quobyte-6ae737e5-5529-43f8-975b-eb49d62fcf0a" released by "delete_volume" :: held 5.219s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:28:44 devstack cinder-volume[88095]: WARNING cinder.quota [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:28:44 devstack cinder-volume[88095]: WARNING cinder.quota [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Created reservations ['ab9cb04c-0e01-441b-8dc9-2e5b24e1c681', 'c775e8fa-274a-4227-83e4-57cc4ff397f5', '06009cd9-638a-44b2-ab20-81b1c928dbd3', '16b9312e-1209-4327-952f-ea3daf85a1ac'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:45 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:28:45 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.954s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:45 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:28:45 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Deleted volume successfully. Jul 30 16:28:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-036f7f5c-d6f7-49ea-a463-342281964812 tempest-VolumesAdminNegativeTest-1554910429 None] Lock "cinder-6ae737e5-5529-43f8-975b-eb49d62fcf0a-delete_volume" released by "delete_volume" :: held 7.117s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:47 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:28:47 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:47 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.365s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 8 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:28:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:28:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-c5d0a702-89e8-40f3-8e2b-ae0839d0afd7 req-0425f1d1-ea08-4e24-9eb3-48ca94f8aedc tempest-DeleteServersTestJSON-1022258091 None] Terminate volume connection completed successfully. Jul 30 16:28:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-c5d0a702-89e8-40f3-8e2b-ae0839d0afd7 req-0425f1d1-ea08-4e24-9eb3-48ca94f8aedc tempest-DeleteServersTestJSON-1022258091 None] Deleting attachment 2eabf1ed-ba0d-484e-9296-aa21d16d3cbb. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:28:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Acquiring lock "cinder-da51f4b6-2b02-4d35-acd3-8338ab06622d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:28:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Lock "cinder-da51f4b6-2b02-4d35-acd3-8338ab06622d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:28:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Acquiring lock "cinder-quobyte-da51f4b6-2b02-4d35-acd3-8338ab06622d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:28:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Lock "cinder-quobyte-da51f4b6-2b02-4d35-acd3-8338ab06622d" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:28:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9997f1c8-fdfe-4a8f-8753-e23626f91c7d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:28:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:51 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d Jul 30 16:28:51 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:51 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d" returned: 0 in 0.509s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:51 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d Jul 30 16:28:51 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:51 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-da51f4b6-2b02-4d35-acd3-8338ab06622d" returned: 0 in 0.572s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Lock "cinder-quobyte-da51f4b6-2b02-4d35-acd3-8338ab06622d" released by "delete_volume" :: held 1.168s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Created reservations ['99958747-50a4-4d7b-a32c-20fdec9bfb3e', '9b24688c-f75e-4314-b5d7-56ef6884bb49', '18d79d4c-1ed2-4cf7-8bc5-fb14b654eb01', '6d786da7-7987-436b-a4a1-c6d1c4208172'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:52 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:28:52 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:52 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.408s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:28:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Deleted volume successfully. Jul 30 16:28:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0ac36854-6e9f-4fd8-9558-f85da9b7f6c6 tempest-DeleteServersTestJSON-1022258091 None] Lock "cinder-da51f4b6-2b02-4d35-acd3-8338ab06622d-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Flow 'volume_create_manager' (c271bf41-7562-4c30-b390-924a81c654d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd699328-3ccf-4ec1-8979-738c00155364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd699328-3ccf-4ec1-8979-738c00155364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-754618042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7e2ed6-8f06-41b5-9efa-43991ce3b181,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67bd303fbcb24ed69274633b3fcd8fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:28:54Z,use_quota=True,user_id='a09699bdb9bf48cf849978cdef6f3af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37202d69-d5eb-4741-8707-41d1b5f1a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37202d69-d5eb-4741-8707-41d1b5f1a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d784aba-0a67-4775-bfe3-9e0190110b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d784aba-0a67-4775-bfe3-9e0190110b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7e2ed6-8f06-41b5-9efa-43991ce3b181', 'volume_name': 'volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfcfc71-be20-466e-94a1-443bfcf34267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfcfc71-be20-466e-94a1-443bfcf34267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9549155-1e19-4de4-9da7-4e3cab02cf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:54 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Volume 9f7e2ed6-8f06-41b5-9efa-43991ce3b181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181', 'volume_size': 1} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-754618042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7e2ed6-8f06-41b5-9efa-43991ce3b181,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67bd303fbcb24ed69274633b3fcd8fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:28:54Z,use_quota=True,user_id='a09699bdb9bf48cf849978cdef6f3af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Creating volume 9f7e2ed6-8f06-41b5-9efa-43991ce3b181 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:28:54 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:28:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:54 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 1073741824 Jul 30 16:28:54 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:55 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 1073741824" returned: 0 in 0.682s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:55 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 Jul 30 16:28:55 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:55 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181" returned: 0 in 0.440s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9549155-1e19-4de4-9da7-4e3cab02cf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91dcf06b-f879-4804-b24e-e23be48edde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:28:55 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Volume volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 (9f7e2ed6-8f06-41b5-9efa-43991ce3b181): created successfully Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91dcf06b-f879-4804-b24e-e23be48edde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:28:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Flow 'volume_create_manager' (c271bf41-7562-4c30-b390-924a81c654d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:28:55 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-e61221c3-3b50-4ecb-ba33-bb6a7d973d10 req-381a17c3-c256-4773-bfbd-856dc30b83e1 tempest-VolumesGetTestJSON-37421723 None] Created volume successfully. Jul 30 16:28:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Acquiring lock "cinder-9f7e2ed6-8f06-41b5-9efa-43991ce3b181-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:28:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Lock "cinder-9f7e2ed6-8f06-41b5-9efa-43991ce3b181-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:28:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Acquiring lock "cinder-quobyte-9f7e2ed6-8f06-41b5-9efa-43991ce3b181" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:28:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Lock "cinder-quobyte-9f7e2ed6-8f06-41b5-9efa-43991ce3b181" acquired by "delete_volume" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:28:57 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45885b0-c303-4998-9db1-ee0e82849199]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:28:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:57 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 Jul 30 16:28:57 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:57 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181" returned: 0 in 0.480s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:57 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181 Jul 30 16:28:57 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:58 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f7e2ed6-8f06-41b5-9efa-43991ce3b181" returned: 0 in 0.360s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Lock "cinder-quobyte-9f7e2ed6-8f06-41b5-9efa-43991ce3b181" released by "delete_volume" :: held 0.891s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG cinder.quota [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Created reservations ['098d866a-6bc8-4867-a7af-2dec263c96a0', '2b0138dd-5315-4ed6-b102-c61366e8ec31', '02212ae0-3a25-4607-90dd-f01889021dfe', 'e0e823b1-e6c4-4d75-9c2a-1d8fafee07dd'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:58 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:28:58 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:58 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.402s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG cinder.manager [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:28:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Deleted volume successfully. Jul 30 16:28:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-dc5fde90-e6a7-4667-b71c-d6237cf59ad4 req-96fec9aa-fa74-40f0-84b3-1209089e8861 tempest-VolumesGetTestJSON-37421723 None] Lock "cinder-9f7e2ed6-8f06-41b5-9efa-43991ce3b181-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Acquiring lock "cinder-584d3697-bceb-4cd0-ab34-968c9eac5f29-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "cinder-584d3697-bceb-4cd0-ab34-968c9eac5f29-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Acquiring lock "cinder-quobyte-584d3697-bceb-4cd0-ab34-968c9eac5f29" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "cinder-quobyte-584d3697-bceb-4cd0-ab34-968c9eac5f29" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f462fba-a437-4139-98b9-e655c6aded27]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:02 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 Jul 30 16:29:02 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:03 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29" returned: 0 in 0.645s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:03 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29 Jul 30 16:29:03 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:03 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-584d3697-bceb-4cd0-ab34-968c9eac5f29" returned: 0 in 0.401s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "cinder-quobyte-584d3697-bceb-4cd0-ab34-968c9eac5f29" released by "delete_volume" :: held 1.107s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:03 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Created reservations ['0b8ca6fb-d5da-4289-a121-d596d6ff0500', '91b786da-2242-4bc9-8526-b11059879a0b', 'f9567a85-dc82-4ded-b83b-55594131c2e9', '54620f3c-96d8-407f-b128-5c08afdfa10c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:04 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:04 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:04 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.545s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Deleted volume successfully. Jul 30 16:29:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4dd115d0-7fe3-4903-9f13-4d7de893f78e tempest-ServerRescueNegativeTestJSON-1385789633 None] Lock "cinder-584d3697-bceb-4cd0-ab34-968c9eac5f29-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5462f3c3-2efd-48dd-ba5d-df3b3be595ad tempest-GroupsTest-1256767380 None] Group tempest-Group1-1323348617: creating Jul 30 16:29:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5462f3c3-2efd-48dd-ba5d-df3b3be595ad tempest-GroupsTest-1256767380 None] Group tempest-Group1-1323348617: created successfully Jul 30 16:29:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5462f3c3-2efd-48dd-ba5d-df3b3be595ad tempest-GroupsTest-1256767380 None] Create group completed successfully. Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Flow 'volume_create_manager' (a568d4bf-3a79-45c9-816d-358826da3147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc1a384-2601-4cc4-8cf9-0824d95d477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc1a384-2601-4cc4-8cf9-0824d95d477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-897705443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe0fa40-0efd-4cd7-b1e3-661daee09b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c1b95c0f6540c2901ea410fc146c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:08Z,use_quota=True,user_id='12fa32c7719b4fc0a54a48ae671ab749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12178758-ea9c-44af-b828-a37f431419ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12178758-ea9c-44af-b828-a37f431419ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8197c55-633a-4d76-90c9-cd24e7c85986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8197c55-633a-4d76-90c9-cd24e7c85986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe0fa40-0efd-4cd7-b1e3-661daee09b2d', 'volume_name': 'volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b768bec-b1a3-41cb-b3fe-0d89cb2f4f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b768bec-b1a3-41cb-b3fe-0d89cb2f4f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab603fe-b84e-4a08-83ff-c059ed5cd2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:08 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Volume afe0fa40-0efd-4cd7-b1e3-661daee09b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d', 'volume_size': 1} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-897705443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe0fa40-0efd-4cd7-b1e3-661daee09b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c1b95c0f6540c2901ea410fc146c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:08Z,use_quota=True,user_id='12fa32c7719b4fc0a54a48ae671ab749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Creating volume afe0fa40-0efd-4cd7-b1e3-661daee09b2d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:29:08 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:29:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:08 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d 1073741824 Jul 30 16:29:08 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:09 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d 1073741824" returned: 0 in 0.765s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-61407782-e0f3-42ba-b794-c83a351965bb tempest-GroupsTest-1256767380 None] Group tempest-Group2-36833773: creating Jul 30 16:29:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-61407782-e0f3-42ba-b794-c83a351965bb tempest-GroupsTest-1256767380 None] Group tempest-Group2-36833773: created successfully Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-61407782-e0f3-42ba-b794-c83a351965bb tempest-GroupsTest-1256767380 None] Create group completed successfully. Jul 30 16:29:09 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d Jul 30 16:29:09 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:09 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" returned: 0 in 0.291s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab603fe-b84e-4a08-83ff-c059ed5cd2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d5e1ac-379e-4a12-885f-3e1cccf97f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:09 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Volume volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d (afe0fa40-0efd-4cd7-b1e3-661daee09b2d): created successfully Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d5e1ac-379e-4a12-885f-3e1cccf97f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Flow 'volume_create_manager' (a568d4bf-3a79-45c9-816d-358826da3147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-734c9b8a-3864-4b0e-b714-bfa1d45a4627 req-8dcfc1fb-b26e-44df-b48d-4fb61fbf564d tempest-VolumesSnapshotsTestJSON-1561775994 None] Created volume successfully. Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Flow 'volume_create_manager' (f13d2a00-2636-4ac8-9bee-c8729d145de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a8b83e-f427-40ce-b9b8-e4e34a5d85ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a8b83e-f427-40ce-b9b8-e4e34a5d85ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-56553141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e15b07d-ac68-44c6-acea-027441bfd9c7,host='devstack@QuobyteHD#QuobyteHD',id=893910bf-ad71-4eca-a7fd-d59ff1f346cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329383ae7fbe4f0081dfc8c0c70a45ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:11Z,use_quota=True,user_id='e583c3a3513f47a4a23d5779aa0f33da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a02dddc-2a4f-4ea0-89bc-35293025a65e),volume_type_id=5a02dddc-2a4f-4ea0-89bc-35293025a65e)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1fef93-b8bb-462c-8e44-60677aa723d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1fef93-b8bb-462c-8e44-60677aa723d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ce4942-cc85-4508-a7f6-ee0dec00fa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ce4942-cc85-4508-a7f6-ee0dec00fa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '893910bf-ad71-4eca-a7fd-d59ff1f346cc', 'volume_name': 'volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1c5a79-7e90-4e0e-9395-cd51c6a8a307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1c5a79-7e90-4e0e-9395-cd51c6a8a307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9645a1cb-99db-4983-a929-cc4347a4dc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:11 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Volume 893910bf-ad71-4eca-a7fd-d59ff1f346cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc', 'volume_size': 1} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4e15b07d-ac68-44c6-acea-027441bfd9c7,created_at=2026-07-30T14:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-56553141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e15b07d-ac68-44c6-acea-027441bfd9c7,host='devstack@QuobyteHD#QuobyteHD',id=893910bf-ad71-4eca-a7fd-d59ff1f346cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329383ae7fbe4f0081dfc8c0c70a45ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:11Z,use_quota=True,user_id='e583c3a3513f47a4a23d5779aa0f33da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a02dddc-2a4f-4ea0-89bc-35293025a65e),volume_type_id=5a02dddc-2a4f-4ea0-89bc-35293025a65e)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Creating volume 893910bf-ad71-4eca-a7fd-d59ff1f346cc {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:29:11 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:11 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc 1073741824 Jul 30 16:29:11 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:11 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc 1073741824" returned: 0 in 0.656s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:12 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc Jul 30 16:29:12 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:12 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc" returned: 0 in 0.250s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.912s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9645a1cb-99db-4983-a929-cc4347a4dc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f74da67-fcbb-43ae-a350-1e37e8d944ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Creating offline snapshot faec57fe-8abb-43a0-84c5-3f28313c2a6f of volume afe0fa40-0efd-4cd7-b1e3-661daee09b2d {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:29:12 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Volume volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc (893910bf-ad71-4eca-a7fd-d59ff1f346cc): created successfully Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f74da67-fcbb-43ae-a350-1e37e8d944ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Flow 'volume_create_manager' (f13d2a00-2636-4ac8-9bee-c8729d145de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c22c6-2001-407e-b187-43e76eca9f3f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:12 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7a70db7e-6bec-4e66-992a-8f1e21b9e259 tempest-GroupsTest-1256767380 None] Created volume successfully. Jul 30 16:29:12 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d Jul 30 16:29:12 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:12 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" returned: 0 in 0.393s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:12 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f 1G Jul 30 16:29:12 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:13 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f 1G" returned: 0 in 0.577s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:13 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f Jul 30 16:29:13 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:13 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f" returned: 0 in 0.393s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:13 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f is being set with open permissions: ugo+rw Jul 30 16:29:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:13 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f Jul 30 16:29:13 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:14 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f" returned: 0 in 0.360s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:14 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.info Jul 30 16:29:14 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:14 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Acquiring lock "cinder-quobyte-893910bf-ad71-4eca-a7fd-d59ff1f346cc" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.info" returned: 0 in 0.379s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:14 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.info is being set with open permissions: ugo+rw Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Lock "cinder-quobyte-893910bf-ad71-4eca-a7fd-d59ff1f346cc" acquired by "delete_volume" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:14 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.info Jul 30 16:29:14 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[98324fda-7a95-4e66-9e51-9ab4c77389d6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:14 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc Jul 30 16:29:14 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:14 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.info" returned: 0 in 0.299s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-2b7d3253-0adc-48db-9d8f-492b465dfd52 req-7fbeece6-8880-4fcf-8c2f-f9a875410748 tempest-VolumesSnapshotsTestJSON-1561775994 None] Create snapshot completed successfully Jul 30 16:29:14 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc" returned: 0 in 0.472s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:15 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc Jul 30 16:29:15 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:15 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-893910bf-ad71-4eca-a7fd-d59ff1f346cc" returned: 0 in 0.299s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Lock "cinder-quobyte-893910bf-ad71-4eca-a7fd-d59ff1f346cc" released by "delete_volume" :: held 0.821s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Created reservations ['881f9dbb-45e8-40b5-9c35-3ea753bc6e96'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:15 devstack cinder-volume[88095]: WARNING cinder.quota [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-794701778 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-794701778, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:29:15 devstack cinder-volume[88095]: WARNING cinder.quota [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-794701778 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-794701778, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Created reservations ['7f3ccc32-83c5-4534-b0dc-af202c92fbb6', '4431c04e-6a30-4919-8d73-045e5d91b784', 'd694cdbc-5dbe-49b5-a922-c96e76e76d83', 'caf610c7-5b41-4502-bd39-9f67a8e64cfb'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:15 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:15 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:15 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.374s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "cinder-faec57fe-8abb-43a0-84c5-3f28313c2a6f-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:16 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-270b3508-bc5c-4859-83a0-7fee300a8ec0 tempest-GroupsTest-1256767380 None] Delete group completed successfully. Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Created reservations ['719f4a5c-f802-455c-9504-24c7bdbe29db'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-faec57fe-8abb-43a0-84c5-3f28313c2a6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.115s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "cinder-quobyte-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-quobyte-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" acquired by "delete_snapshot" :: waited 0.058s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "cinder-quobyte-faec57fe-8abb-43a0-84c5-3f28313c2a6f" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-quobyte-faec57fe-8abb-43a0-84c5-3f28313c2a6f" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Deleting offline snapshot faec57fe-8abb-43a0-84c5-3f28313c2a6f of volume afe0fa40-0efd-4cd7-b1e3-661daee09b2d {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] snapshot_file for this snap is: volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c6063e-c930-4121-85b7-039c7595ed4d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:16 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:16 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:16 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f Jul 30 16:29:16 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:16 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.317s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:16 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-359c3a53-f794-43fb-925d-b4159391b160 tempest-GroupsTest-1256767380 None] Delete group completed successfully. Jul 30 16:29:16 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f" returned: 0 in 0.495s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaf02de-486e-4084-9675-4a424a0bb68d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:17 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d Jul 30 16:29:17 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:17 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" returned: 0 in 0.591s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:17 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f Jul 30 16:29:17 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6c039c92-be6e-4b2c-aed8-522898f5f9f8 tempest-GroupsTest-1256767380 None] Group tempest-GroupsTest-Group-57380644: creating Jul 30 16:29:18 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6c039c92-be6e-4b2c-aed8-522898f5f9f8 tempest-GroupsTest-1256767380 None] Group tempest-GroupsTest-Group-57380644: created successfully Jul 30 16:29:18 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6c039c92-be6e-4b2c-aed8-522898f5f9f8 tempest-GroupsTest-1256767380 None] Create group completed successfully. Jul 30 16:29:18 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f" returned: 0 in 0.566s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:18 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f Jul 30 16:29:18 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:18 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d.faec57fe-8abb-43a0-84c5-3f28313c2a6f" returned: 0 in 0.329s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-quobyte-faec57fe-8abb-43a0-84c5-3f28313c2a6f" released by "_delete_snapshot" :: held 2.178s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-quobyte-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" released by "delete_snapshot" :: held 2.225s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:18 devstack cinder-volume[88095]: WARNING cinder.quota [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:29:18 devstack cinder-volume[88095]: DEBUG cinder.quota [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Created reservations ['a80e7969-cc50-45d5-bf8c-10b1fde61ed9', '91ed6da3-8b7f-4232-89fe-f17b54ed6b33', 'de7a48e0-493d-4126-9e46-c25235a8d191', 'aafbd862-caec-412f-b9b3-bb3253aedfd3'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:18 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Delete snapshot completed successfully. Jul 30 16:29:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-41c43438-4c72-42e6-9025-cd135b8c8836 req-e2562a9d-9a4e-434f-a298-6770e5d7c70e tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-faec57fe-8abb-43a0-84c5-3f28313c2a6f-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "cinder-afe0fa40-0efd-4cd7-b1e3-661daee09b2d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-afe0fa40-0efd-4cd7-b1e3-661daee09b2d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Flow 'volume_create_manager' (86e44615-29c9-4643-84cf-e35ae0a50d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa7eac0-8a35-4a7a-a972-cbcec04806ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa7eac0-8a35-4a7a-a972-cbcec04806ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052993394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e1db252-146a-48f2-92d2-8909332e3a27,host='devstack@QuobyteHD#QuobyteHD',id=2906bdb9-b965-4362-9e23-78552f1cf0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329383ae7fbe4f0081dfc8c0c70a45ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:20Z,use_quota=True,user_id='e583c3a3513f47a4a23d5779aa0f33da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11a5cf3-076f-4acf-801f-9d430fb19fec),volume_type_id=d11a5cf3-076f-4acf-801f-9d430fb19fec)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13352a84-38bc-4648-8376-8265ccd2c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13352a84-38bc-4648-8376-8265ccd2c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ab616a-b01f-452c-b8fc-e9079fc907ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ab616a-b01f-452c-b8fc-e9079fc907ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2906bdb9-b965-4362-9e23-78552f1cf0c8', 'volume_name': 'volume-2906bdb9-b965-4362-9e23-78552f1cf0c8', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6bf6b1-5dee-4856-a610-b4eb623d80b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6bf6b1-5dee-4856-a610-b4eb623d80b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4def7c20-2685-4817-bcaa-8d97148e9c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:19 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Volume 2906bdb9-b965-4362-9e23-78552f1cf0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2906bdb9-b965-4362-9e23-78552f1cf0c8', 'volume_size': 1} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e1db252-146a-48f2-92d2-8909332e3a27,created_at=2026-07-30T14:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052993394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e1db252-146a-48f2-92d2-8909332e3a27,host='devstack@QuobyteHD#QuobyteHD',id=2906bdb9-b965-4362-9e23-78552f1cf0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329383ae7fbe4f0081dfc8c0c70a45ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:20Z,use_quota=True,user_id='e583c3a3513f47a4a23d5779aa0f33da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11a5cf3-076f-4acf-801f-9d430fb19fec),volume_type_id=d11a5cf3-076f-4acf-801f-9d430fb19fec)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Creating volume 2906bdb9-b965-4362-9e23-78552f1cf0c8 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:29:19 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "cinder-quobyte-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:19 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 1073741824 Jul 30 16:29:19 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-quobyte-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" acquired by "delete_volume" :: waited 0.038s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[851ba32e-56ba-4fa1-95b4-ecad1bdfaebc]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:20 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d Jul 30 16:29:20 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:20 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 1073741824" returned: 0 in 0.558s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:20 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" returned: 0 in 0.496s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:20 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 Jul 30 16:29:20 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:20 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d Jul 30 16:29:20 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:20 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8" returned: 0 in 0.291s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4def7c20-2685-4817-bcaa-8d97148e9c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2906bdb9-b965-4362-9e23-78552f1cf0c8', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a2509b-69b1-49a7-ae81-9ecc7b24cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:20 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Volume volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 (2906bdb9-b965-4362-9e23-78552f1cf0c8): created successfully Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a2509b-69b1-49a7-ae81-9ecc7b24cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Flow 'volume_create_manager' (86e44615-29c9-4643-84cf-e35ae0a50d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:20 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7b79afce-89a3-4461-93f2-30a6ba638aeb tempest-GroupsTest-1256767380 None] Created volume successfully. Jul 30 16:29:20 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" returned: 0 in 0.418s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-quobyte-afe0fa40-0efd-4cd7-b1e3-661daee09b2d" released by "delete_volume" :: held 1.024s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:20 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=75,cinder:SELECT=70,cinder:INSERT=23,cinder:DELETE=8 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.quota [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Created reservations ['33fae414-0ae4-4f54-9aef-28f7d17fe270', '542da467-2fbc-4cd4-868c-069b050509e7', 'b3befa25-e4d1-4c26-b568-d7642a5ec536', '4f142526-475a-4746-a320-20db7e7267ba'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:21 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:21 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:21 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.383s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.manager [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:21 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Deleted volume successfully. Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-b7415e18-e936-4e1f-a95f-56045b9cc4be req-1e830d87-d010-482d-9ecd-a7566714a7d6 tempest-VolumesSnapshotsTestJSON-1561775994 None] Lock "cinder-afe0fa40-0efd-4cd7-b1e3-661daee09b2d-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=78,cinder:UPDATE=90,cinder:DELETE=4,cinder:INSERT=15 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Flow 'volume_create_manager' (479dec55-ddde-47c1-851c-9d88555fddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee6aa88-b853-4cf2-9fec-186c303c73a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee6aa88-b853-4cf2-9fec-186c303c73a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478005910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e1db252-146a-48f2-92d2-8909332e3a27,host='devstack@QuobyteHD#QuobyteHD',id=d9cbcf52-67bb-4772-8ac4-62eb045d0903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329383ae7fbe4f0081dfc8c0c70a45ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:22Z,use_quota=True,user_id='e583c3a3513f47a4a23d5779aa0f33da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11a5cf3-076f-4acf-801f-9d430fb19fec),volume_type_id=d11a5cf3-076f-4acf-801f-9d430fb19fec)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b8169b-6f1e-483a-83a4-46f846d2fcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b8169b-6f1e-483a-83a4-46f846d2fcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c4e165-ac97-4717-a6db-5cbe1a755c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c4e165-ac97-4717-a6db-5cbe1a755c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9cbcf52-67bb-4772-8ac4-62eb045d0903', 'volume_name': 'volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bca3b4-5fa0-49f6-84a6-e91d82e10e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bca3b4-5fa0-49f6-84a6-e91d82e10e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5ab231-a7b6-45a8-a97c-b2be0839e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:21 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Volume d9cbcf52-67bb-4772-8ac4-62eb045d0903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903', 'volume_size': 1} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e1db252-146a-48f2-92d2-8909332e3a27,created_at=2026-07-30T14:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478005910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e1db252-146a-48f2-92d2-8909332e3a27,host='devstack@QuobyteHD#QuobyteHD',id=d9cbcf52-67bb-4772-8ac4-62eb045d0903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329383ae7fbe4f0081dfc8c0c70a45ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:22Z,use_quota=True,user_id='e583c3a3513f47a4a23d5779aa0f33da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11a5cf3-076f-4acf-801f-9d430fb19fec),volume_type_id=d11a5cf3-076f-4acf-801f-9d430fb19fec)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Creating volume d9cbcf52-67bb-4772-8ac4-62eb045d0903 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:29:21 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:29:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:21 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 1073741824 Jul 30 16:29:21 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:22 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 1073741824" returned: 0 in 0.516s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:22 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 Jul 30 16:29:22 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:22 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903" returned: 0 in 0.286s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5ab231-a7b6-45a8-a97c-b2be0839e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae1d0b8-84f5-477a-b78e-9c7a4469d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:22 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Volume volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 (d9cbcf52-67bb-4772-8ac4-62eb045d0903): created successfully Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae1d0b8-84f5-477a-b78e-9c7a4469d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Flow 'volume_create_manager' (479dec55-ddde-47c1-851c-9d88555fddcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:23 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-43769902-4d8b-4693-b281-cc482c87a146 tempest-GroupsTest-1256767380 None] Created volume successfully. Jul 30 16:29:24 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0a0eacff-e748-49ca-833c-e45a1f3335b0 tempest-GroupsTest-1256767380 None] Update group completed successfully. Jul 30 16:29:26 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4f41c14b-bf33-4587-b9b2-5a0958950043 tempest-GroupsTest-1256767380 None] Update group completed successfully. Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Flow 'volume_create_manager' (af2de82a-7e3a-4837-8c6e-d6d3ace19cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a91b21c-b974-42d6-a4a3-c97b5bfb4a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a91b21c-b974-42d6-a4a3-c97b5bfb4a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1062700670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb1dd427b89f4a9ea888fc88e99e7842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:28Z,use_quota=True,user_id='3cd39dded0934682acce152dea7a850e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc19a934-7269-4c5a-bef2-2b9ff48916d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc19a934-7269-4c5a-bef2-2b9ff48916d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0cbad4-8305-4f67-b9d2-ab6cb71fe90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0cbad4-8305-4f67-b9d2-ab6cb71fe90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2', 'volume_name': 'volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a502ba1b-0f68-4b10-9cd1-47ee89a21dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a502ba1b-0f68-4b10-9cd1-47ee89a21dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e04b1a4-41a3-43e1-b079-8f36f5179b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:27 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Volume 5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2', 'volume_size': 1} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1062700670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb1dd427b89f4a9ea888fc88e99e7842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:28Z,use_quota=True,user_id='3cd39dded0934682acce152dea7a850e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Creating volume 5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:29:27 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:27 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 1073741824 Jul 30 16:29:27 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Acquiring lock "cinder-quobyte-2906bdb9-b965-4362-9e23-78552f1cf0c8" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Lock "cinder-quobyte-2906bdb9-b965-4362-9e23-78552f1cf0c8" acquired by "delete_volume" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5d13af-ad7b-49c9-a931-2e9a393fa930]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:28 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 Jul 30 16:29:28 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:28 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 1073741824" returned: 0 in 0.635s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:28 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 Jul 30 16:29:28 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:28 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8" returned: 0 in 0.451s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:28 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8 Jul 30 16:29:28 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:28 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2" returned: 0 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e04b1a4-41a3-43e1-b079-8f36f5179b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba8cee4-912c-4e3e-9804-eace24745732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Volume volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 (5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2): created successfully Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba8cee4-912c-4e3e-9804-eace24745732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:28 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Flow 'volume_create_manager' (af2de82a-7e3a-4837-8c6e-d6d3ace19cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2906bdb9-b965-4362-9e23-78552f1cf0c8" returned: 0 in 0.334s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:28 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5e2258cd-3b6c-4049-bf2b-1deffc3557f3 tempest-VolumesTestJSON-2084863692 None] Created volume successfully. Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Lock "cinder-quobyte-2906bdb9-b965-4362-9e23-78552f1cf0c8" released by "delete_volume" :: held 0.857s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Acquiring lock "cinder-quobyte-d9cbcf52-67bb-4772-8ac4-62eb045d0903" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Lock "cinder-quobyte-d9cbcf52-67bb-4772-8ac4-62eb045d0903" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a87f17-716b-491c-8d1a-cd8e5e21d61b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:28 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 Jul 30 16:29:28 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:29 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903" returned: 0 in 0.425s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:29 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903 Jul 30 16:29:29 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:29 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d9cbcf52-67bb-4772-8ac4-62eb045d0903" returned: 0 in 0.300s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Lock "cinder-quobyte-d9cbcf52-67bb-4772-8ac4-62eb045d0903" released by "delete_volume" :: held 0.781s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:29 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Created reservations ['5e14b1f5-3cae-4c8c-9a3a-cc2097a37ec9'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:29 devstack cinder-volume[88095]: WARNING cinder.quota [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-715827510 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-715827510, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:29:29 devstack cinder-volume[88095]: WARNING cinder.quota [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-715827510 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-715827510, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:29:29 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Created reservations ['0a4d5179-2be8-46f9-aae9-c4a533ae4928', '5fa2883b-ca8b-4c84-99b5-9cef931017d2', 'b618f8b7-0212-41c8-9743-65302e28d3ad', '3adbd977-e6aa-47a6-8bd0-62a4bb3db2cc'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:29 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Created reservations ['d4826bc0-539b-4053-80bb-f6e465dc2fe3', '94dbcf4e-bb97-4fc4-b115-185bc9affc27', 'a6a3ce02-9794-4ea6-b72c-82080493cad8', 'e0ccfaae-2513-4cf6-9706-796916eee7c5'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:30 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:30 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:30 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.338s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f86ab22e-8c8e-4b97-8e44-33e6e1159860 tempest-GroupsTest-1256767380 None] Delete group completed successfully. Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Flow 'volume_create_manager' (78a694ca-c18d-4876-9e97-6c10ac26e12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dd8fee-85cf-4130-a821-9293443e226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dd8fee-85cf-4130-a821-9293443e226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-438383185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cad49b3-95ed-492f-b87a-babeeb308139,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb1dd427b89f4a9ea888fc88e99e7842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:30Z,use_quota=True,user_id='3cd39dded0934682acce152dea7a850e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc07984-2a7c-4853-8d20-8393f25b8e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc07984-2a7c-4853-8d20-8393f25b8e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77fca2a-c423-43aa-bb48-33afeda91acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77fca2a-c423-43aa-bb48-33afeda91acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cad49b3-95ed-492f-b87a-babeeb308139', 'volume_name': 'volume-4cad49b3-95ed-492f-b87a-babeeb308139', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab31d33-ddcb-49e0-ad93-bb30b9c21397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab31d33-ddcb-49e0-ad93-bb30b9c21397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee8f641-82ae-415e-8614-dae9aeb6322f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Volume 4cad49b3-95ed-492f-b87a-babeeb308139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cad49b3-95ed-492f-b87a-babeeb308139', 'volume_size': 1} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-438383185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cad49b3-95ed-492f-b87a-babeeb308139,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb1dd427b89f4a9ea888fc88e99e7842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:30Z,use_quota=True,user_id='3cd39dded0934682acce152dea7a850e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Creating volume 4cad49b3-95ed-492f-b87a-babeeb308139 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:29:30 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:29:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:30 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 1073741824 Jul 30 16:29:30 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:31 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 1073741824" returned: 0 in 0.687s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:31 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 Jul 30 16:29:31 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:31 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139" returned: 0 in 0.454s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee8f641-82ae-415e-8614-dae9aeb6322f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cad49b3-95ed-492f-b87a-babeeb308139', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b5bc2a-8a27-49dd-8227-aae0069f7cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Volume volume-4cad49b3-95ed-492f-b87a-babeeb308139 (4cad49b3-95ed-492f-b87a-babeeb308139): created successfully Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b5bc2a-8a27-49dd-8227-aae0069f7cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Flow 'volume_create_manager' (78a694ca-c18d-4876-9e97-6c10ac26e12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:31 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2027dd97-1321-4e25-ad46-ce634e6f7ffa tempest-VolumesTestJSON-2084863692 None] Created volume successfully. Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Flow 'volume_create_manager' (038952c9-704d-4037-9902-d6b38356c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0fcc9f-ce34-471d-89a3-ce3e6de3d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0fcc9f-ce34-471d-89a3-ce3e6de3d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-561157764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278ceac7-c09a-4d11-8699-87a325ee12a9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb1dd427b89f4a9ea888fc88e99e7842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:33Z,use_quota=True,user_id='3cd39dded0934682acce152dea7a850e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7543fbcc-8ff8-4e83-bbbd-e98259bb2757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7543fbcc-8ff8-4e83-bbbd-e98259bb2757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3561d000-899d-4976-b6b0-70783fe15f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3561d000-899d-4976-b6b0-70783fe15f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278ceac7-c09a-4d11-8699-87a325ee12a9', 'volume_name': 'volume-278ceac7-c09a-4d11-8699-87a325ee12a9', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f04f09-6c15-40c5-822f-d56150a99249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f04f09-6c15-40c5-822f-d56150a99249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730d3181-ae0e-4706-92af-79cd926fab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:33 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Volume 278ceac7-c09a-4d11-8699-87a325ee12a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278ceac7-c09a-4d11-8699-87a325ee12a9', 'volume_size': 1} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-561157764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278ceac7-c09a-4d11-8699-87a325ee12a9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bb1dd427b89f4a9ea888fc88e99e7842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:33Z,use_quota=True,user_id='3cd39dded0934682acce152dea7a850e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Creating volume 278ceac7-c09a-4d11-8699-87a325ee12a9 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:29:33 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:33 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 1073741824 Jul 30 16:29:33 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:33 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 1073741824" returned: 0 in 0.531s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:34 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 Jul 30 16:29:34 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:34 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:29:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730d3181-ae0e-4706-92af-79cd926fab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278ceac7-c09a-4d11-8699-87a325ee12a9', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e97d335-9129-464c-8b78-3f978748b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:34 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Volume volume-278ceac7-c09a-4d11-8699-87a325ee12a9 (278ceac7-c09a-4d11-8699-87a325ee12a9): created successfully Jul 30 16:29:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e97d335-9129-464c-8b78-3f978748b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Flow 'volume_create_manager' (038952c9-704d-4037-9902-d6b38356c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:34 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6f0841f6-e415-4fd3-a17a-2a8b756b8424 tempest-VolumesTestJSON-2084863692 None] Created volume successfully. Jul 30 16:29:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Acquiring lock "cinder-278ceac7-c09a-4d11-8699-87a325ee12a9-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Lock "cinder-278ceac7-c09a-4d11-8699-87a325ee12a9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Acquiring lock "cinder-quobyte-278ceac7-c09a-4d11-8699-87a325ee12a9" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Lock "cinder-quobyte-278ceac7-c09a-4d11-8699-87a325ee12a9" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[610af1fd-9ef7-47d1-91c6-2731d613b0a5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:37 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 Jul 30 16:29:37 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:37 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9" returned: 0 in 0.446s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:37 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9 Jul 30 16:29:37 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:37 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-278ceac7-c09a-4d11-8699-87a325ee12a9" returned: 0 in 0.291s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Lock "cinder-quobyte-278ceac7-c09a-4d11-8699-87a325ee12a9" released by "delete_volume" :: held 0.793s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Created reservations ['a055ca36-39e7-4de6-95b5-bffcbb312d15', 'bc650bd3-04ae-4126-9187-eb82a65845f4', '53014fe5-5413-40e6-97b0-0d06656282e9', '374a080b-bc2f-4b40-8272-ef3ee33db80f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:38 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:38 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Acquiring lock "cinder-4cad49b3-95ed-492f-b87a-babeeb308139-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Lock "cinder-4cad49b3-95ed-492f-b87a-babeeb308139-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3ac9e07d-7f3b-4657-9d14-d3770ff2757d tempest-GroupsV314Test-1234267609 None] Group tempest-GroupsV314Test-Group-1113102889: creating Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Acquiring lock "cinder-quobyte-4cad49b3-95ed-492f-b87a-babeeb308139" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Lock "cinder-quobyte-4cad49b3-95ed-492f-b87a-babeeb308139" acquired by "delete_volume" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3ac9e07d-7f3b-4657-9d14-d3770ff2757d tempest-GroupsV314Test-1234267609 None] Group tempest-GroupsV314Test-Group-1113102889: created successfully Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5d8037-cb04-49b9-9676-378a4c87791b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:38 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.451s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Deleted volume successfully. Jul 30 16:29:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3ac9e07d-7f3b-4657-9d14-d3770ff2757d tempest-GroupsV314Test-1234267609 None] Create group completed successfully. Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c0620dd-c4ae-457a-86e8-e5ee5a872366 tempest-VolumesTestJSON-2084863692 None] Lock "cinder-278ceac7-c09a-4d11-8699-87a325ee12a9-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:38 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 Jul 30 16:29:38 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:38 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139" returned: 0 in 0.400s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:38 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139 Jul 30 16:29:38 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:39 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4cad49b3-95ed-492f-b87a-babeeb308139" returned: 0 in 0.322s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Lock "cinder-quobyte-4cad49b3-95ed-492f-b87a-babeeb308139" released by "delete_volume" :: held 0.783s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Created reservations ['a7caca3c-7ec0-458f-9a07-0b26676a1af8', 'ed1a97fb-aaf8-458b-8c3c-08f178787b08', '3b1c9eae-1b1c-463c-a230-9cf6b79fd874', '42bf2527-6339-4b09-9d2a-d53dfc7e19a0'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:39 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:39 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Acquiring lock "cinder-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Lock "cinder-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Acquiring lock "cinder-quobyte-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Lock "cinder-quobyte-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2" acquired by "delete_volume" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eff6ee9-8933-4368-97ea-4ac153aa36ba]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:39 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.426s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Deleted volume successfully. Jul 30 16:29:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5fc21fb4-7b30-4fb3-b1a3-56ff47cb80ba tempest-VolumesTestJSON-2084863692 None] Lock "cinder-4cad49b3-95ed-492f-b87a-babeeb308139-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:39 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 Jul 30 16:29:39 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:40 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2" returned: 0 in 0.692s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:29:40 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2 Jul 30 16:29:40 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Flow 'volume_create_manager' (4d57de85-449d-4a93-928b-8890e4d614d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb9f6bc-7257-4f06-b845-563fde650e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb9f6bc-7257-4f06-b845-563fde650e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1659572205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ae2e7a8-f3af-4966-813e-beb92bfafa60,host='devstack@QuobyteHD#QuobyteHD',id=cd0019ae-20a6-41f7-8bf4-65287f68ef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f741fe1e71364d22aab90c403b0c1a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:40Z,use_quota=True,user_id='b4f2a0d1b0164abb9a7e00a1c51fceab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(318d5a82-24d6-4d6f-b0b7-cee6e9d4520c),volume_type_id=318d5a82-24d6-4d6f-b0b7-cee6e9d4520c)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f035b2-ef56-40da-b65e-bad97a4a0ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f035b2-ef56-40da-b65e-bad97a4a0ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0cb91a-cae7-42f4-8b37-abbcd85582c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0cb91a-cae7-42f4-8b37-abbcd85582c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0019ae-20a6-41f7-8bf4-65287f68ef11', 'volume_name': 'volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42052650-6e73-4568-be79-dcce48373327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42052650-6e73-4568-be79-dcce48373327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35310b3-94d7-4e4e-b1a9-f68cbb7173ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:40 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Volume cd0019ae-20a6-41f7-8bf4-65287f68ef11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11', 'volume_size': 1} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ae2e7a8-f3af-4966-813e-beb92bfafa60,created_at=2026-07-30T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1659572205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ae2e7a8-f3af-4966-813e-beb92bfafa60,host='devstack@QuobyteHD#QuobyteHD',id=cd0019ae-20a6-41f7-8bf4-65287f68ef11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f741fe1e71364d22aab90c403b0c1a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:29:40Z,use_quota=True,user_id='b4f2a0d1b0164abb9a7e00a1c51fceab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(318d5a82-24d6-4d6f-b0b7-cee6e9d4520c),volume_type_id=318d5a82-24d6-4d6f-b0b7-cee6e9d4520c)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Creating volume cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:29:40 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:40 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 1073741824 Jul 30 16:29:40 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:40 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2" returned: 0 in 0.520s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Lock "cinder-quobyte-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2" released by "delete_volume" :: held 1.300s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:40 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Created reservations ['011d4ee5-9ae3-49d1-a93d-da498e7eb6c0', '992ea9db-57c6-4270-b32f-0e12ea6cf33c', '41ba1ad2-d797-435c-b760-3ed64fb9992a', '51af1cb7-50f0-487c-ae3c-afb6e61b3fb1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:41 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:41 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:41 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 1073741824" returned: 0 in 0.895s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:41 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 Jul 30 16:29:41 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:41 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.406s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:41 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Deleted volume successfully. Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bb2adf8-dffe-406c-b836-ed216f46df8d tempest-VolumesTestJSON-2084863692 None] Lock "cinder-5f5945f0-0d5f-4b8c-a74f-5d0ce51d47e2-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:41 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11" returned: 0 in 0.358s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35310b3-94d7-4e4e-b1a9-f68cbb7173ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19d7bcc-549f-4298-adb7-d18de557ad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:29:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Volume volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 (cd0019ae-20a6-41f7-8bf4-65287f68ef11): created successfully Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19d7bcc-549f-4298-adb7-d18de557ad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:29:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Flow 'volume_create_manager' (4d57de85-449d-4a93-928b-8890e4d614d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:29:41 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-051d6399-9df8-43b9-bfac-4938e21fbdf5 tempest-GroupsV314Test-1234267609 None] Created volume successfully. Jul 30 16:29:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:43 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Cloning volume cd0019ae-20a6-41f7-8bf4-65287f68ef11 to volume 993b7e18-bae9-44c1-9510-254b5770b342 Jul 30 16:29:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Creating offline snapshot 5aa4049b-76ea-4a6f-a08d-156b3a8d9478 of volume cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:29:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ee0179-8e0d-4fa7-966c-6a01ef22e5ef]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:43 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 Jul 30 16:29:43 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:44 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11" returned: 0 in 0.562s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:44 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 1G Jul 30 16:29:44 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:44 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 1G" returned: 0 in 0.598s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:44 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 Jul 30 16:29:44 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:45 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478" returned: 0 in 0.518s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:45 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:29:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:45 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 Jul 30 16:29:45 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:45 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478" returned: 0 in 0.501s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:45 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.info Jul 30 16:29:45 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:46 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.info" returned: 0 in 0.382s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:46 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:46 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.info Jul 30 16:29:46 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:46 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.info" returned: 0 in 0.372s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Acquiring lock "cinder-quobyte-993b7e18-bae9-44c1-9510-254b5770b342" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Lock "cinder-quobyte-993b7e18-bae9-44c1-9510-254b5770b342" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] snapshot: 5aa4049b-76ea-4a6f-a08d-156b3a8d9478, volume: 993b7e18-bae9-44c1-9510-254b5770b342, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0e541-00c5-4403-b04a-f3a2e17481dc]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:46 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 Jul 30 16:29:46 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:47 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478" returned: 0 in 0.580s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba0bee0-e12d-482c-8588-c619877f80a4]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:47 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:29:47 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-51392d3c-4f55-4283-aba0-3d34bdebc543 tempest-BackendsCapabilitiesAdminTestsJSON-1115912597 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576942443848, 'free_capacity_gb': 1775.7576942443848, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-eeb1268d-98c0-4d29-a573-d45a7fd9d202 tempest-BackendsCapabilitiesAdminTestsJSON-1115912597 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576942443848, 'free_capacity_gb': 1775.7576942443848, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:29:47 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 Jul 30 16:29:47 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:47 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.512s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:48 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11" returned: 0 in 0.639s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:29:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:29:48 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:29:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:48 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 Jul 30 16:29:48 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:55 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342" returned: 0 in 7.329s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:29:55 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Converted 1024.00 MB image at 139.67 MB/s Jul 30 16:29:55 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:55 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 Jul 30 16:29:55 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:55 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342" returned: 0 in 0.320s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Lock "cinder-quobyte-993b7e18-bae9-44c1-9510-254b5770b342" released by "_copy_volume_from_snapshot" :: held 8.990s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Acquiring lock "cinder-quobyte-5aa4049b-76ea-4a6f-a08d-156b3a8d9478" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Lock "cinder-quobyte-5aa4049b-76ea-4a6f-a08d-156b3a8d9478" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Deleting offline snapshot 5aa4049b-76ea-4a6f-a08d-156b3a8d9478 of volume cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] snapshot_file for this snap is: volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eab399-ad2b-4e57-9fbe-e8009b2361dd]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:55 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=67,cinder:SELECT=49,cinder:DELETE=3,cinder:INSERT=16 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:29:55 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 Jul 30 16:29:55 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:56 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478" returned: 0 in 0.497s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:29:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b662f402-6573-488a-9005-5a8724214621]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:56 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 Jul 30 16:29:56 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:57 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11" returned: 0 in 0.814s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:57 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 Jul 30 16:29:57 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:57 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478" returned: 0 in 0.453s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:57 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478 Jul 30 16:29:57 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:57 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11.5aa4049b-76ea-4a6f-a08d-156b3a8d9478" returned: 0 in 0.295s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Lock "cinder-quobyte-5aa4049b-76ea-4a6f-a08d-156b3a8d9478" released by "_delete_snapshot" :: held 2.226s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:29:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.482s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:29:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d3280110-58c9-4bb1-9905-519c5fd1a58f tempest-GroupsV314Test-1234267609 None] Create group from source-group-7ae2e7a8-f3af-4966-813e-beb92bfafa60 completed successfully. Jul 30 16:29:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Acquiring lock "cinder-quobyte-993b7e18-bae9-44c1-9510-254b5770b342" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:29:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Lock "cinder-quobyte-993b7e18-bae9-44c1-9510-254b5770b342" acquired by "delete_volume" :: waited 0.044s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:29:59 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[18733947-95b2-41b3-899a-12ff560ec8ab]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:29:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:59 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 Jul 30 16:29:59 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:59 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342" returned: 0 in 0.468s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:59 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342 Jul 30 16:29:59 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:59 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-993b7e18-bae9-44c1-9510-254b5770b342" returned: 0 in 0.425s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Lock "cinder-quobyte-993b7e18-bae9-44c1-9510-254b5770b342" released by "delete_volume" :: held 0.994s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Created reservations ['2c85a985-3fbd-494b-9802-ac6b31a1563a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:00 devstack cinder-volume[88095]: WARNING cinder.quota [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-337058957 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-337058957, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:30:00 devstack cinder-volume[88095]: WARNING cinder.quota [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-337058957 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-337058957, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Created reservations ['7ab2c7f6-e571-4e8f-8cca-ddceb6f770cc', '23b2538f-912b-4711-9269-f0f4eb700c57', 'd012a623-da84-45b7-8361-706a22a94cd2', 'c884dc53-a714-4518-adc8-3d50ddc38b1b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:00 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:00 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:00 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.441s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-158ed477-3d9e-431e-a60f-1e5f15699338 tempest-GroupsV314Test-1234267609 None] Delete group completed successfully. Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Acquiring lock "cinder-quobyte-cd0019ae-20a6-41f7-8bf4-65287f68ef11" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Lock "cinder-quobyte-cd0019ae-20a6-41f7-8bf4-65287f68ef11" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f38730d-d3ef-4479-82c1-149c8669128e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:01 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 Jul 30 16:30:01 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Flow 'volume_create_manager' (cc68e09a-3535-4bfb-98a9-9a19b46641b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17deb52-ea82-4966-96da-97edbc8a059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17deb52-ea82-4966-96da-97edbc8a059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-768463562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b5475e-85d1-4b39-a2fe-26de71cd2ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d414a8032842eaa555d5f283b8b233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:01Z,use_quota=True,user_id='49c08216acb146e48096761515816887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4584d76d-b6ea-49a2-8f75-79761efaeb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4584d76d-b6ea-49a2-8f75-79761efaeb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85913a9c-321b-4713-a822-6c39be24247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85913a9c-321b-4713-a822-6c39be24247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b5475e-85d1-4b39-a2fe-26de71cd2ae6', 'volume_name': 'volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad494a98-aaa8-447e-b188-644b58b7c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad494a98-aaa8-447e-b188-644b58b7c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04e0cee-8f38-436d-81c8-bce7cb518789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:01 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Volume c7b5475e-85d1-4b39-a2fe-26de71cd2ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6', 'volume_size': 1} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-768463562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b5475e-85d1-4b39-a2fe-26de71cd2ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d414a8032842eaa555d5f283b8b233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:01Z,use_quota=True,user_id='49c08216acb146e48096761515816887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Creating volume c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:01 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:01 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 1073741824 Jul 30 16:30:01 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:01 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11" returned: 0 in 0.441s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:01 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11 Jul 30 16:30:01 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:01 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 1073741824" returned: 0 in 0.533s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:01 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cd0019ae-20a6-41f7-8bf4-65287f68ef11" returned: 0 in 0.351s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Lock "cinder-quobyte-cd0019ae-20a6-41f7-8bf4-65287f68ef11" released by "delete_volume" :: held 0.882s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:01 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 Jul 30 16:30:01 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Created reservations ['f1eee987-e817-4597-958b-00e6a516ffa4'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:01 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Created reservations ['929c723d-08b6-43a9-9cd6-956ba602183a', '8c2c68b4-64dc-4a7e-ae1b-0ef564067359', '921e283a-e7a0-4e2b-9c60-14aa7b864dda', 'a706797f-d5a9-4eac-b2d9-27d349b5dd1c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:02 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:02 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:02 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6" returned: 0 in 0.440s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04e0cee-8f38-436d-81c8-bce7cb518789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deba801b-3b3d-4ad9-ba53-6b940e8413c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-407117b0-21e2-4a11-857f-d2941b120eec tempest-GroupSnapshotsTest-503455304 None] Group tempest-GroupSnapshotsTest-Group-371202538: creating Jul 30 16:30:02 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Volume volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 (c7b5475e-85d1-4b39-a2fe-26de71cd2ae6): created successfully Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deba801b-3b3d-4ad9-ba53-6b940e8413c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Flow 'volume_create_manager' (cc68e09a-3535-4bfb-98a9-9a19b46641b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-84961152-c7aa-4762-94b6-00a1e7b3f509 tempest-TaggedAttachmentsTest-58278690 None] Created volume successfully. Jul 30 16:30:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-407117b0-21e2-4a11-857f-d2941b120eec tempest-GroupSnapshotsTest-503455304 None] Group tempest-GroupSnapshotsTest-Group-371202538: created successfully Jul 30 16:30:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-407117b0-21e2-4a11-857f-d2941b120eec tempest-GroupSnapshotsTest-503455304 None] Create group completed successfully. Jul 30 16:30:02 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.272s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:02 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7d3f4903-5b48-4212-a5c9-9710f345dcc9 tempest-GroupsV314Test-1234267609 None] Delete group completed successfully. Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Flow 'volume_create_manager' (9ab2855a-e45f-4151-9e27-dd10f15e3660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5879f8b-6059-4fd5-9eaa-2cfe27599d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5879f8b-6059-4fd5-9eaa-2cfe27599d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1035626579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e77fb95-421b-4915-8005-b7d69748ba3d,host='devstack@QuobyteHD#QuobyteHD',id=139fb7ae-65b4-4be1-b54d-8873154db929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ceda5f3246d4bb58a4d20447713cc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:04Z,use_quota=True,user_id='94a2a60b0db44f849aa523d4ff773feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0b0241e-f1f9-45a5-a41f-a6beaf04e92b),volume_type_id=a0b0241e-f1f9-45a5-a41f-a6beaf04e92b)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c50703-56af-4444-8b3f-e0d4753654c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c50703-56af-4444-8b3f-e0d4753654c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19de6968-aa08-4ef6-8488-436b7cb90861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19de6968-aa08-4ef6-8488-436b7cb90861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139fb7ae-65b4-4be1-b54d-8873154db929', 'volume_name': 'volume-139fb7ae-65b4-4be1-b54d-8873154db929', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2194ca94-894c-4cee-a4d2-d4c5f306ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2194ca94-894c-4cee-a4d2-d4c5f306ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b56ace-953f-4463-8917-28826b93e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:04 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Volume 139fb7ae-65b4-4be1-b54d-8873154db929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139fb7ae-65b4-4be1-b54d-8873154db929', 'volume_size': 1} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e77fb95-421b-4915-8005-b7d69748ba3d,created_at=2026-07-30T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1035626579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e77fb95-421b-4915-8005-b7d69748ba3d,host='devstack@QuobyteHD#QuobyteHD',id=139fb7ae-65b4-4be1-b54d-8873154db929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ceda5f3246d4bb58a4d20447713cc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:04Z,use_quota=True,user_id='94a2a60b0db44f849aa523d4ff773feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0b0241e-f1f9-45a5-a41f-a6beaf04e92b),volume_type_id=a0b0241e-f1f9-45a5-a41f-a6beaf04e92b)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Creating volume 139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:04 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:04 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 1073741824 Jul 30 16:30:04 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:04 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 1073741824" returned: 0 in 0.534s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:04 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 Jul 30 16:30:04 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:04 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929" returned: 0 in 0.278s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:30:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b56ace-953f-4463-8917-28826b93e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139fb7ae-65b4-4be1-b54d-8873154db929', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6103a3-1e64-465e-96b1-0f7605cab311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:05 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Volume volume-139fb7ae-65b4-4be1-b54d-8873154db929 (139fb7ae-65b4-4be1-b54d-8873154db929): created successfully Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6103a3-1e64-465e-96b1-0f7605cab311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Flow 'volume_create_manager' (9ab2855a-e45f-4151-9e27-dd10f15e3660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e778e69e-c732-44d0-83a2-d855e4904615 tempest-GroupSnapshotsTest-503455304 None] Created volume successfully. Jul 30 16:30:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] GroupSnapshot e182ed60-8721-4741-a888-9487101c50cb: creating. Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Group snapshot e182ed60-8721-4741-a888-9487101c50cb: creating. {{(pid=88095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Creating offline snapshot 248a595e-868d-476b-8a08-1779c10e5857 of volume 139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e90837-fb9d-47d3-b01e-5b45d586849b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:05 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 Jul 30 16:30:05 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:06 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929" returned: 0 in 0.461s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:06 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 1G Jul 30 16:30:06 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:06 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 1G" returned: 0 in 0.450s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb7ae-65b4-4be1-b54d-8873154db929 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:06 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb7ae-65b4-4be1-b54d-8873154db929 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 Jul 30 16:30:06 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:06 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139fb7ae-65b4-4be1-b54d-8873154db929 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857" returned: 0 in 0.356s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:06 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:30:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:06 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 Jul 30 16:30:06 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:07 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857" returned: 0 in 0.253s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:07 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.info Jul 30 16:30:07 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:07 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.info" returned: 0 in 0.278s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:07 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:30:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:07 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.info Jul 30 16:30:07 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:07 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.info" returned: 0 in 0.313s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5d280743-e11a-48ac-814c-a60a7e62cfcf tempest-GroupsV320Test-627256485 None] Group tempest-GroupsV320Test-Group-816234742: creating Jul 30 16:30:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5d280743-e11a-48ac-814c-a60a7e62cfcf tempest-GroupsV320Test-627256485 None] Group tempest-GroupsV320Test-Group-816234742: created successfully Jul 30 16:30:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5d280743-e11a-48ac-814c-a60a7e62cfcf tempest-GroupsV320Test-627256485 None] Create group completed successfully. Jul 30 16:30:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-57c9f02a-63f0-4d93-903c-bc6e3a8c6c76 tempest-GroupSnapshotsTest-503455304 None] group_snapshot e182ed60-8721-4741-a888-9487101c50cb: created successfully Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Created reservations ['e748aad4-e79d-41e0-a2a8-21ee47e22c13'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-248a595e-868d-476b-8a08-1779c10e5857-0cd10b75-4013-4b9d-a5fc-de034d1fac87" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-248a595e-868d-476b-8a08-1779c10e5857-0cd10b75-4013-4b9d-a5fc-de034d1fac87" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Creating volume 0cd10b75-4013-4b9d-a5fc-de034d1fac87 from snapshot 248a595e-868d-476b-8a08-1779c10e5857 {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-0cd10b75-4013-4b9d-a5fc-de034d1fac87" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-0cd10b75-4013-4b9d-a5fc-de034d1fac87" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] snapshot: 248a595e-868d-476b-8a08-1779c10e5857, volume: 0cd10b75-4013-4b9d-a5fc-de034d1fac87, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:10 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:10 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35f94a6-a18a-44f0-8842-bae534a7fbfb]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:10 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 Jul 30 16:30:10 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:10 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.295s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-dff3cd8d-ce91-448d-b95c-fab046c8f8ef tempest-GroupsV320Test-627256485 None] Delete group completed successfully. Jul 30 16:30:10 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857" returned: 0 in 0.485s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb7ae-65b4-4be1-b54d-8873154db929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6a8fb-835b-4226-bcec-e105943ea76e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:10 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 Jul 30 16:30:10 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:11 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929" returned: 0 in 0.448s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:30:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:30:11 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:30:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:11 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 Jul 30 16:30:11 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Flow 'volume_create_manager' (325f5a62-8329-4201-b501-ad65006f9234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f669631e-9287-430b-a026-5cf320d537ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f669631e-9287-430b-a026-5cf320d537ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1464225578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2781b07-cbcb-4783-962f-5d40e09ebb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b246f98bfb9439cbd6ae859c1f04149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:13Z,use_quota=True,user_id='c0a8d1ae65af4924b592f515fe135576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d8c1d0-98fc-4986-bc77-a3205b54254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d8c1d0-98fc-4986-bc77-a3205b54254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7579d52a-be84-4e6a-8a7d-02665202e3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7579d52a-be84-4e6a-8a7d-02665202e3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2781b07-cbcb-4783-962f-5d40e09ebb14', 'volume_name': 'volume-b2781b07-cbcb-4783-962f-5d40e09ebb14', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1be49c-30fc-4324-a234-ebcbc04f9af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1be49c-30fc-4324-a234-ebcbc04f9af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1cf2ce-bcf0-4df3-9d3c-039990850051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:13 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Volume b2781b07-cbcb-4783-962f-5d40e09ebb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2781b07-cbcb-4783-962f-5d40e09ebb14', 'volume_size': 1} Jul 30 16:30:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:18 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87" returned: 0 in 7.642s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:18 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:30:18 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Converted 1024.00 MB image at 133.98 MB/s Jul 30 16:30:18 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:30:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:18 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 Jul 30 16:30:18 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:19 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87" returned: 0 in 0.302s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-0cd10b75-4013-4b9d-a5fc-de034d1fac87" released by "_copy_volume_from_snapshot" :: held 9.023s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-248a595e-868d-476b-8a08-1779c10e5857-0cd10b75-4013-4b9d-a5fc-de034d1fac87" released by "_create_volume_from_snapshot" :: held 9.129s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.171s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.469s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1464225578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2781b07-cbcb-4783-962f-5d40e09ebb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b246f98bfb9439cbd6ae859c1f04149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:13Z,use_quota=True,user_id='c0a8d1ae65af4924b592f515fe135576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Creating volume b2781b07-cbcb-4783-962f-5d40e09ebb14 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:19 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:19 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 1073741824 Jul 30 16:30:19 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:19 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f0cf48d6-e15a-42a9-80d6-ac81df571725 tempest-GroupSnapshotsTest-503455304 None] Create group from source-snapshot-e182ed60-8721-4741-a888-9487101c50cb completed successfully. Jul 30 16:30:19 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 1073741824" returned: 0 in 0.657s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:19 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 Jul 30 16:30:19 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-0cd10b75-4013-4b9d-a5fc-de034d1fac87" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-0cd10b75-4013-4b9d-a5fc-de034d1fac87" acquired by "delete_volume" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[221f95e9-8a47-4b14-ba00-f6ee325dcc30]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:20 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:20 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 Jul 30 16:30:20 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14" returned: 0 in 0.450s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1cf2ce-bcf0-4df3-9d3c-039990850051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2781b07-cbcb-4783-962f-5d40e09ebb14', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df5fa7d-f011-4254-bf1b-91afe2b2e6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:20 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Volume volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 (b2781b07-cbcb-4783-962f-5d40e09ebb14): created successfully Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df5fa7d-f011-4254-bf1b-91afe2b2e6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Flow 'volume_create_manager' (325f5a62-8329-4201-b501-ad65006f9234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:20 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-13fbba09-9019-41b6-a678-9e3123c4bdae tempest-AttachVolumeTestJSON-144241327 None] Created volume successfully. Jul 30 16:30:20 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87" returned: 0 in 0.459s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:20 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87 Jul 30 16:30:20 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:20 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0cd10b75-4013-4b9d-a5fc-de034d1fac87" returned: 0 in 0.296s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-0cd10b75-4013-4b9d-a5fc-de034d1fac87" released by "delete_volume" :: held 0.831s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:20 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['54ffc16e-361e-46a4-81f2-b453f89a7b64'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:21 devstack cinder-volume[88095]: WARNING cinder.quota [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1178795252 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1178795252, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:30:21 devstack cinder-volume[88095]: WARNING cinder.quota [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1178795252 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1178795252, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['70dc43b2-1b86-4702-adf3-247b010c1c6c', '865f7501-c931-4cc8-9886-ff899d7025d3', 'dc4ec732-52c9-42ba-94d1-ff4da5fba582', 'f667a630-3a49-4015-a7e3-e32721fbf383'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:21 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:21 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:21 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.409s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:21 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] group_snapshot e182ed60-8721-4741-a888-9487101c50cb: deleting Jul 30 16:30:21 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a79abca7-4ba2-4afd-b908-97fcb3c14e45 tempest-GroupSnapshotsTest-503455304 None] Delete group completed successfully. Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] group_snapshot e182ed60-8721-4741-a888-9487101c50cb: deleting {{(pid=88095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-139fb7ae-65b4-4be1-b54d-8873154db929" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-139fb7ae-65b4-4be1-b54d-8873154db929" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-248a595e-868d-476b-8a08-1779c10e5857" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-248a595e-868d-476b-8a08-1779c10e5857" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Deleting offline snapshot 248a595e-868d-476b-8a08-1779c10e5857 of volume 139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] snapshot_file for this snap is: volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca8f0c-f0d9-4ed2-bd7e-d9c1dc5a6465]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:22 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 Jul 30 16:30:22 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:22 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857" returned: 0 in 0.585s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139fb7ae-65b4-4be1-b54d-8873154db929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:30:22 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5de8e7-983b-4a23-8fa3-19d08734f10f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:22 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 Jul 30 16:30:22 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=100,cinder:UPDATE=107,cinder:INSERT=21,cinder:DELETE=7 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-57c19c5c-6496-4548-abae-03854f082b1c req-8f42dc80-aec5-4b1f-8d0b-dcedbcd5e132 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-57c19c5c-6496-4548-abae-03854f082b1c req-8f42dc80-aec5-4b1f-8d0b-dcedbcd5e132 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-57c19c5c-6496-4548-abae-03854f082b1c req-8f42dc80-aec5-4b1f-8d0b-dcedbcd5e132 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:23 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929" returned: 0 in 0.827s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-57c19c5c-6496-4548-abae-03854f082b1c req-8f42dc80-aec5-4b1f-8d0b-dcedbcd5e132 tempest-AttachVolumeTestJSON-144241327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-b2781b07-cbcb-4783-962f-5d40e09ebb14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73d3c05c-ac88-4ede-945f-1b7daa008e75', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:30:23 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 Jul 30 16:30:23 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:23 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-57c19c5c-6496-4548-abae-03854f082b1c req-8f42dc80-aec5-4b1f-8d0b-dcedbcd5e132 tempest-AttachVolumeTestJSON-144241327 None] attachment_update completed successfully. Jul 30 16:30:23 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857" returned: 0 in 0.449s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:23 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857 Jul 30 16:30:23 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:24 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929.248a595e-868d-476b-8a08-1779c10e5857" returned: 0 in 0.463s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-248a595e-868d-476b-8a08-1779c10e5857" released by "_delete_snapshot" :: held 2.547s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-139fb7ae-65b4-4be1-b54d-8873154db929" released by "delete_snapshot" :: held 2.608s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Flow 'volume_create_manager' (5384c2f3-f1c9-48b6-86a6-01bc4017c74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c3d5ef-241f-4f92-8311-069cb0a9e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c3d5ef-241f-4f92-8311-069cb0a9e173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2093033177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4e074a-42e2-4e81-8a71-97e147485777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='544f0c78f56848958aaf7a2bc8c75e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:24Z,use_quota=True,user_id='8ed3b17450494c95a80368884f16f409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b57958-f2f5-4248-bc9f-c9bcdd149282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b57958-f2f5-4248-bc9f-c9bcdd149282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e410170f-4958-4913-88d6-eca2946534e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e410170f-4958-4913-88d6-eca2946534e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4e074a-42e2-4e81-8a71-97e147485777', 'volume_name': 'volume-2b4e074a-42e2-4e81-8a71-97e147485777', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4243c6cc-fe2b-4bb2-a4ec-c093c2d73c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4243c6cc-fe2b-4bb2-a4ec-c093c2d73c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcd648a-8730-4cff-a2f0-3c1415218236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:24 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Volume 2b4e074a-42e2-4e81-8a71-97e147485777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4e074a-42e2-4e81-8a71-97e147485777', 'volume_size': 1} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2093033177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4e074a-42e2-4e81-8a71-97e147485777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='544f0c78f56848958aaf7a2bc8c75e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:24Z,use_quota=True,user_id='8ed3b17450494c95a80368884f16f409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Creating volume 2b4e074a-42e2-4e81-8a71-97e147485777 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:24 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:24 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 1073741824 Jul 30 16:30:24 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:24 devstack cinder-volume[88095]: WARNING cinder.quota [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1178795252 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1178795252, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:30:24 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] Created reservations ['6235be48-4ca3-4d88-b15b-6c6d36df2e53', 'f96c3a75-1825-4e8c-a10c-51e6e778e21a', 'ceaae00e-18d3-4756-9d01-602dbc1cec03', '986542ad-c978-480c-bbd3-934f2212611e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:24 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5dc50750-f0cd-46f1-bd77-90f72e457bfd tempest-GroupSnapshotsTest-503455304 None] group_snapshot e182ed60-8721-4741-a888-9487101c50cb: deleted successfully Jul 30 16:30:25 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 1073741824" returned: 0 in 0.532s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:25 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 Jul 30 16:30:25 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-139fb7ae-65b4-4be1-b54d-8873154db929" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-139fb7ae-65b4-4be1-b54d-8873154db929" acquired by "delete_volume" :: waited 0.035s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:25 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777" returned: 0 in 0.487s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6ea6c3-8e90-49ff-bcc8-2e4bcf841086]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcd648a-8730-4cff-a2f0-3c1415218236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4e074a-42e2-4e81-8a71-97e147485777', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0d929c-06dc-47ee-b98e-9069e0ac0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:25 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Volume volume-2b4e074a-42e2-4e81-8a71-97e147485777 (2b4e074a-42e2-4e81-8a71-97e147485777): created successfully Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0d929c-06dc-47ee-b98e-9069e0ac0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Flow 'volume_create_manager' (5384c2f3-f1c9-48b6-86a6-01bc4017c74f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:25 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-19e716b3-ee18-4638-895c-38efa65b3c15 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Created volume successfully. Jul 30 16:30:25 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 Jul 30 16:30:25 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:26 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929" returned: 0 in 0.436s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:26 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929 Jul 30 16:30:26 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:26 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-139fb7ae-65b4-4be1-b54d-8873154db929" returned: 0 in 0.278s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-139fb7ae-65b4-4be1-b54d-8873154db929" released by "delete_volume" :: held 0.855s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Acquiring lock "cinder-2b4e074a-42e2-4e81-8a71-97e147485777-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "cinder-2b4e074a-42e2-4e81-8a71-97e147485777-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Acquiring lock "cinder-quobyte-2b4e074a-42e2-4e81-8a71-97e147485777" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "cinder-quobyte-2b4e074a-42e2-4e81-8a71-97e147485777" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['cba110f9-aaf4-4f88-9509-31df4ef780b2'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[535685bd-6fa6-48e9-b2e5-cd290cbbe7a8]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:26 devstack cinder-volume[88095]: WARNING cinder.db.api [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1178795252'] Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['c516e01b-7ac1-456d-b151-b87e99afe387', '87690cd3-50f6-48ec-bfce-c96a5bfecb70', '87955987-35e0-40a7-af7a-b13fc4464281', '2914cdaa-0e24-4394-a255-e544925dbd81'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:26 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 Jul 30 16:30:26 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:26 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:26 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:27 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777" returned: 0 in 0.521s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:27 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777 Jul 30 16:30:27 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:27 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.460s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7d5119f0-8b53-4c5b-94e0-20e1cced55b8 tempest-GroupSnapshotsTest-503455304 None] Delete group completed successfully. Jul 30 16:30:27 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2b4e074a-42e2-4e81-8a71-97e147485777" returned: 0 in 0.350s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "cinder-quobyte-2b4e074a-42e2-4e81-8a71-97e147485777" released by "delete_volume" :: held 0.926s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-83abe6e7-cfc9-4085-a6f3-cbc391eb7299 tempest-GroupSnapshotsTest-503455304 None] Group tempest-GroupSnapshotsTest-Group-194309419: creating Jul 30 16:30:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-83abe6e7-cfc9-4085-a6f3-cbc391eb7299 tempest-GroupSnapshotsTest-503455304 None] Group tempest-GroupSnapshotsTest-Group-194309419: created successfully Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Created reservations ['85a7a783-3d18-4ba6-8b6d-68519f689ad8', 'be9a995e-83cc-4a2b-8e2a-11ba54107620', '961b31e4-5606-4f9c-8aab-96daedc7ebc6', '615550e2-c319-41af-ad15-c6338e3b98fb'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-83abe6e7-cfc9-4085-a6f3-cbc391eb7299 tempest-GroupSnapshotsTest-503455304 None] Create group completed successfully. Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:27 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:27 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:28 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.364s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:28 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:28 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Deleted volume successfully. Jul 30 16:30:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a62cc4fa-da59-4f9d-b956-39d5edbb8c0b tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "cinder-2b4e074a-42e2-4e81-8a71-97e147485777-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Flow 'volume_create_manager' (5cfc863d-a95b-49a2-826f-55a1baafcaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5016154-dd10-414a-8983-8f88a5d94ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5016154-dd10-414a-8983-8f88a5d94ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874256917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85c7186b-4db9-4e26-b40a-aabf45ab85a0,host='devstack@QuobyteHD#QuobyteHD',id=6ac4f1af-f835-4e46-8966-00315f2663f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ceda5f3246d4bb58a4d20447713cc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:30Z,use_quota=True,user_id='94a2a60b0db44f849aa523d4ff773feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e6d01f7-426a-4236-888a-b3386e1bbfad),volume_type_id=4e6d01f7-426a-4236-888a-b3386e1bbfad)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c84b63-5e08-4261-97f5-d1a05e2dbd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c84b63-5e08-4261-97f5-d1a05e2dbd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12aaa6e3-6ee8-4001-b255-c1057fecee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12aaa6e3-6ee8-4001-b255-c1057fecee12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac4f1af-f835-4e46-8966-00315f2663f2', 'volume_name': 'volume-6ac4f1af-f835-4e46-8966-00315f2663f2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8f6fca-935d-4c9d-9d74-8ca72410d1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8f6fca-935d-4c9d-9d74-8ca72410d1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a5d51e-733e-4c56-a132-029557452713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Volume 6ac4f1af-f835-4e46-8966-00315f2663f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac4f1af-f835-4e46-8966-00315f2663f2', 'volume_size': 1} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85c7186b-4db9-4e26-b40a-aabf45ab85a0,created_at=2026-07-30T14:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874256917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85c7186b-4db9-4e26-b40a-aabf45ab85a0,host='devstack@QuobyteHD#QuobyteHD',id=6ac4f1af-f835-4e46-8966-00315f2663f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ceda5f3246d4bb58a4d20447713cc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:30Z,use_quota=True,user_id='94a2a60b0db44f849aa523d4ff773feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e6d01f7-426a-4236-888a-b3386e1bbfad),volume_type_id=4e6d01f7-426a-4236-888a-b3386e1bbfad)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Creating volume 6ac4f1af-f835-4e46-8966-00315f2663f2 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:30 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:30 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 1073741824 Jul 30 16:30:30 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Flow 'volume_create_manager' (995ec6db-05be-4711-bf04-b00f50a43eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861e291a-3a72-4e28-bf99-b445741874c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861e291a-3a72-4e28-bf99-b445741874c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1692479688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db4a685-6e8b-47ff-afb3-656ea95b28d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='544f0c78f56848958aaf7a2bc8c75e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:30Z,use_quota=True,user_id='8ed3b17450494c95a80368884f16f409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e114e4e-093c-4dce-889e-aa264f2744ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e114e4e-093c-4dce-889e-aa264f2744ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290a18ce-e9e5-42e0-94a1-f7699b3173cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290a18ce-e9e5-42e0-94a1-f7699b3173cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db4a685-6e8b-47ff-afb3-656ea95b28d0', 'volume_name': 'volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d7edfc-94a6-4cf4-9da5-34c245bb9dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d7edfc-94a6-4cf4-9da5-34c245bb9dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3e04da-886f-4c0e-8395-3af831d2b902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Volume 7db4a685-6e8b-47ff-afb3-656ea95b28d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0', 'volume_size': 1} Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:30 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 1073741824" returned: 0 in 0.770s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:31 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 Jul 30 16:30:31 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:31 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2" returned: 0 in 0.417s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1692479688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db4a685-6e8b-47ff-afb3-656ea95b28d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='544f0c78f56848958aaf7a2bc8c75e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:30Z,use_quota=True,user_id='8ed3b17450494c95a80368884f16f409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Creating volume 7db4a685-6e8b-47ff-afb3-656ea95b28d0 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:31 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a5d51e-733e-4c56-a132-029557452713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac4f1af-f835-4e46-8966-00315f2663f2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:31 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 1073741824 Jul 30 16:30:31 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4040637f-decf-442e-ab29-fabcba774e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Volume volume-6ac4f1af-f835-4e46-8966-00315f2663f2 (6ac4f1af-f835-4e46-8966-00315f2663f2): created successfully Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4040637f-decf-442e-ab29-fabcba774e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Flow 'volume_create_manager' (5cfc863d-a95b-49a2-826f-55a1baafcaed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:31 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2fa90f03-be5a-42c4-999f-4794f8cf2b95 tempest-GroupSnapshotsTest-503455304 None] Created volume successfully. Jul 30 16:30:31 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 1073741824" returned: 0 in 0.430s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:31 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 Jul 30 16:30:31 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:32 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0" returned: 0 in 0.277s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:30:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3e04da-886f-4c0e-8395-3af831d2b902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8513c44e-220e-4726-8b17-a193144febb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:32 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Volume volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 (7db4a685-6e8b-47ff-afb3-656ea95b28d0): created successfully Jul 30 16:30:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8513c44e-220e-4726-8b17-a193144febb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Flow 'volume_create_manager' (995ec6db-05be-4711-bf04-b00f50a43eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a797e901-18c9-46c4-be8b-6fa08b8ab903 tempest-VolumeQuotasAdminTestJSON-1009025989 None] Created volume successfully. Jul 30 16:30:32 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Flow 'volume_create_manager' (abfc9c10-1c1f-49ae-af63-e0e606234b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436a2ec4-e2fd-499d-8a31-c1ba9f160a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436a2ec4-e2fd-499d-8a31-c1ba9f160a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-326215256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85c7186b-4db9-4e26-b40a-aabf45ab85a0,host='devstack@QuobyteHD#QuobyteHD',id=405d23e5-5d2e-4020-8d60-d63be6069e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ceda5f3246d4bb58a4d20447713cc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:33Z,use_quota=True,user_id='94a2a60b0db44f849aa523d4ff773feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e6d01f7-426a-4236-888a-b3386e1bbfad),volume_type_id=4e6d01f7-426a-4236-888a-b3386e1bbfad)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cccaf8-655b-4960-a9e8-6cc18cd8a6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cccaf8-655b-4960-a9e8-6cc18cd8a6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cb19eb-4c9a-41b7-b5ee-d4ddcdd6ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cb19eb-4c9a-41b7-b5ee-d4ddcdd6ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405d23e5-5d2e-4020-8d60-d63be6069e26', 'volume_name': 'volume-405d23e5-5d2e-4020-8d60-d63be6069e26', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a118878-1220-49e4-9159-98ac4e0e009c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a118878-1220-49e4-9159-98ac4e0e009c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d37cd69-7373-402b-b18d-9ccddee64313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:33 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Volume 405d23e5-5d2e-4020-8d60-d63be6069e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405d23e5-5d2e-4020-8d60-d63be6069e26', 'volume_size': 1} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85c7186b-4db9-4e26-b40a-aabf45ab85a0,created_at=2026-07-30T14:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-326215256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85c7186b-4db9-4e26-b40a-aabf45ab85a0,host='devstack@QuobyteHD#QuobyteHD',id=405d23e5-5d2e-4020-8d60-d63be6069e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ceda5f3246d4bb58a4d20447713cc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:33Z,use_quota=True,user_id='94a2a60b0db44f849aa523d4ff773feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e6d01f7-426a-4236-888a-b3386e1bbfad),volume_type_id=4e6d01f7-426a-4236-888a-b3386e1bbfad)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Creating volume 405d23e5-5d2e-4020-8d60-d63be6069e26 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:33 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:33 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 1073741824 Jul 30 16:30:33 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:33 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 1073741824" returned: 0 in 0.539s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:33 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 Jul 30 16:30:33 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:34 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26" returned: 0 in 0.352s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d37cd69-7373-402b-b18d-9ccddee64313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405d23e5-5d2e-4020-8d60-d63be6069e26', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2252ae68-845e-49ca-ba88-eee8065ad755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:34 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Volume volume-405d23e5-5d2e-4020-8d60-d63be6069e26 (405d23e5-5d2e-4020-8d60-d63be6069e26): created successfully Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2252ae68-845e-49ca-ba88-eee8065ad755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Flow 'volume_create_manager' (abfc9c10-1c1f-49ae-af63-e0e606234b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:34 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-878a1b4e-1bd3-4dfb-93f7-5f60edb0d825 tempest-GroupSnapshotsTest-503455304 None] Created volume successfully. Jul 30 16:30:34 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9a7b4d82-e2c5-476c-a1c5-06f056a7460d tempest-VolumeQuotasAdminTestJSON-1996616691 None] Transfer volume completed successfully. Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Acquiring lock "cinder-7db4a685-6e8b-47ff-afb3-656ea95b28d0-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Lock "cinder-7db4a685-6e8b-47ff-afb3-656ea95b28d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Acquiring lock "cinder-quobyte-7db4a685-6e8b-47ff-afb3-656ea95b28d0" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Lock "cinder-quobyte-7db4a685-6e8b-47ff-afb3-656ea95b28d0" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[033c0567-6e18-4973-8dbb-50d41ed1074b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:34 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 Jul 30 16:30:34 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:35 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0" returned: 0 in 0.390s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:35 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0 Jul 30 16:30:35 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:35 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7db4a685-6e8b-47ff-afb3-656ea95b28d0" returned: 0 in 0.264s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Lock "cinder-quobyte-7db4a685-6e8b-47ff-afb3-656ea95b28d0" released by "delete_volume" :: held 0.706s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Created reservations ['61caff62-e6d5-4c45-bcaf-856a6543ffea', '9cc83e5a-aff3-402c-a49e-fe6331d6d9a5', '09999c15-ac5b-4f33-b938-8fbb6217da00', '6392f22d-679a-4ac8-a6ff-4ac5f05c37f3'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bc6736f4-f408-4def-ad11-378436f50360 tempest-GroupSnapshotsTest-503455304 None] Update group completed successfully. Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:35 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:35 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:35 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.252s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Deleted volume successfully. Jul 30 16:30:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9f3b330a-4bcf-4e21-81f6-12871f039051 tempest-VolumeQuotasAdminTestJSON-517930090 None] Lock "cinder-7db4a685-6e8b-47ff-afb3-656ea95b28d0-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7db03145-0323-470f-9982-fbffebb5c306 tempest-GroupSnapshotsTest-503455304 None] Update group completed successfully. Jul 30 16:30:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d753d123-e4df-4a95-84dd-d04675bc5e71 tempest-GroupSnapshotsTest-503455304 None] Update group completed successfully. Jul 30 16:30:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-66cca955-bd15-4863-809a-3f998aec320d tempest-GroupSnapshotsTest-503455304 None] Update group completed successfully. Jul 30 16:30:41 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] GroupSnapshot 2787b209-3d0b-415c-b9be-921e8466009a: creating. Jul 30 16:30:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Group snapshot 2787b209-3d0b-415c-b9be-921e8466009a: creating. {{(pid=88095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:30:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Creating offline snapshot 19102141-b136-4c34-bc05-f0f4ba36b686 of volume 6ac4f1af-f835-4e46-8966-00315f2663f2 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:30:41 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d908814e-4dbc-4cb7-9680-0659085cbd0f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:41 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 Jul 30 16:30:41 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:41 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2" returned: 0 in 0.476s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:41 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 1G Jul 30 16:30:41 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:42 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 1G" returned: 0 in 0.671s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac4f1af-f835-4e46-8966-00315f2663f2 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:42 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac4f1af-f835-4e46-8966-00315f2663f2 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 Jul 30 16:30:42 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:42 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac4f1af-f835-4e46-8966-00315f2663f2 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686" returned: 0 in 0.529s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:42 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:30:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:42 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 Jul 30 16:30:42 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:43 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686" returned: 0 in 0.323s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:43 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.info Jul 30 16:30:43 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:43 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.info" returned: 0 in 0.325s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:43 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:30:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:43 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.info Jul 30 16:30:43 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:44 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.info" returned: 0 in 0.481s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.931s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Creating offline snapshot b7650c01-9961-45cf-b16a-8a369fa82ea2 of volume 405d23e5-5d2e-4020-8d60-d63be6069e26 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24746bd5-6cf5-48f0-8f54-c7531215e48e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:44 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 Jul 30 16:30:44 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:44 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26" returned: 0 in 0.451s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:44 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 1G Jul 30 16:30:44 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:45 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 1G" returned: 0 in 0.691s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-405d23e5-5d2e-4020-8d60-d63be6069e26 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:45 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-405d23e5-5d2e-4020-8d60-d63be6069e26 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 Jul 30 16:30:45 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:45 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-405d23e5-5d2e-4020-8d60-d63be6069e26 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2" returned: 0 in 0.413s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:45 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:30:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:45 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 Jul 30 16:30:45 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:46 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2" returned: 0 in 0.331s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:46 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.info Jul 30 16:30:46 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:46 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.info" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:46 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:30:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:46 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.info Jul 30 16:30:46 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:46 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.info" returned: 0 in 0.397s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.704s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6259b883-9074-4889-8d6d-9cf7692c3515 tempest-GroupSnapshotsTest-503455304 None] group_snapshot 2787b209-3d0b-415c-b9be-921e8466009a: created successfully Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:47 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:47 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:47 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.444s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 8 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:30:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] group_snapshot 2787b209-3d0b-415c-b9be-921e8466009a: deleting Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] group_snapshot 2787b209-3d0b-415c-b9be-921e8466009a: deleting {{(pid=88095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:30:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-6ac4f1af-f835-4e46-8966-00315f2663f2" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-6ac4f1af-f835-4e46-8966-00315f2663f2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-19102141-b136-4c34-bc05-f0f4ba36b686" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-19102141-b136-4c34-bc05-f0f4ba36b686" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Deleting offline snapshot 19102141-b136-4c34-bc05-f0f4ba36b686 of volume 6ac4f1af-f835-4e46-8966-00315f2663f2 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] snapshot_file for this snap is: volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9021f630-1cf5-4a83-8e01-92dbb071fb97]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:48 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 Jul 30 16:30:48 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:48 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686" returned: 0 in 0.434s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ac4f1af-f835-4e46-8966-00315f2663f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a2164b-ca7a-4fe2-9664-a3f438757024]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-39bb4fc8-c4ba-4288-bb49-4f11b21d7708 req-b6dd359b-eab6-4fb9-b948-ee95c8c370cc tempest-TaggedAttachmentsTest-58278690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-39bb4fc8-c4ba-4288-bb49-4f11b21d7708 req-b6dd359b-eab6-4fb9-b948-ee95c8c370cc tempest-TaggedAttachmentsTest-58278690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-39bb4fc8-c4ba-4288-bb49-4f11b21d7708 req-b6dd359b-eab6-4fb9-b948-ee95c8c370cc tempest-TaggedAttachmentsTest-58278690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-39bb4fc8-c4ba-4288-bb49-4f11b21d7708 req-b6dd359b-eab6-4fb9-b948-ee95c8c370cc tempest-TaggedAttachmentsTest-58278690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6e0749f-df68-48e8-ac00-dd84993c7579', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:30:48 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 Jul 30 16:30:48 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-39bb4fc8-c4ba-4288-bb49-4f11b21d7708 req-b6dd359b-eab6-4fb9-b948-ee95c8c370cc tempest-TaggedAttachmentsTest-58278690 None] attachment_update completed successfully. Jul 30 16:30:48 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2" returned: 0 in 0.429s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:49 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 Jul 30 16:30:49 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:49 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686" returned: 0 in 0.441s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:49 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686 Jul 30 16:30:49 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:49 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2.19102141-b136-4c34-bc05-f0f4ba36b686" returned: 0 in 0.320s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-19102141-b136-4c34-bc05-f0f4ba36b686" released by "_delete_snapshot" :: held 1.791s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-6ac4f1af-f835-4e46-8966-00315f2663f2" released by "delete_snapshot" :: held 1.838s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-405d23e5-5d2e-4020-8d60-d63be6069e26" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-405d23e5-5d2e-4020-8d60-d63be6069e26" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-b7650c01-9961-45cf-b16a-8a369fa82ea2" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-b7650c01-9961-45cf-b16a-8a369fa82ea2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Deleting offline snapshot b7650c01-9961-45cf-b16a-8a369fa82ea2 of volume 405d23e5-5d2e-4020-8d60-d63be6069e26 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] snapshot_file for this snap is: volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa40ff2-53aa-4e55-b8b9-8db8d2371ad0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:50 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 Jul 30 16:30:50 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:50 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2" returned: 0 in 0.383s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-405d23e5-5d2e-4020-8d60-d63be6069e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:30:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb507ec-cfe8-4e07-9d8d-ab7ceff72e2d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:50 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 Jul 30 16:30:50 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:50 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26" returned: 0 in 0.485s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:50 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 Jul 30 16:30:50 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-6a1766c0-9ade-4a41-bfd3-4bc5e3783dc7 req-8c07c79e-d50a-45fb-9903-65dafc9d1d95 tempest-TaggedAttachmentsTest-58278690 None] Terminate volume connection completed successfully. Jul 30 16:30:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-6a1766c0-9ade-4a41-bfd3-4bc5e3783dc7 req-8c07c79e-d50a-45fb-9903-65dafc9d1d95 tempest-TaggedAttachmentsTest-58278690 None] Deleting attachment e6e0749f-df68-48e8-ac00-dd84993c7579. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:30:51 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2" returned: 0 in 0.451s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:51 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2 Jul 30 16:30:51 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:51 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26.b7650c01-9961-45cf-b16a-8a369fa82ea2" returned: 0 in 0.294s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-b7650c01-9961-45cf-b16a-8a369fa82ea2" released by "_delete_snapshot" :: held 1.730s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-405d23e5-5d2e-4020-8d60-d63be6069e26" released by "delete_snapshot" :: held 1.759s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:51 devstack cinder-volume[88095]: WARNING cinder.quota [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-818035862 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-818035862, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:30:51 devstack cinder-volume[88095]: WARNING cinder.quota [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-818035862 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-818035862, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:30:51 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['6b4b0d6b-9162-4494-9b09-c660de097dec', 'a070b7e1-f6a8-400e-8e5e-9066a130c82d', '149f32d4-4934-428c-a543-017bf108cd68', 'a95af9b9-9501-46f6-9913-f1baf5275bed'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:51 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['67d64bf1-bf6c-4991-b8c4-62a834e55394', '9d8c2514-7e59-42c3-a48f-0fc8db8b3bd6', 'cf3f75f9-1355-436f-b0e0-271836dd4f9a', 'a32b6849-672f-4687-a330-fa8a60198670'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d57fc1fc-00fb-4364-a929-a0cfd9067d37 tempest-GroupSnapshotsTest-503455304 None] group_snapshot 2787b209-3d0b-415c-b9be-921e8466009a: deleted successfully Jul 30 16:30:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-405d23e5-5d2e-4020-8d60-d63be6069e26" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-405d23e5-5d2e-4020-8d60-d63be6069e26" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d549f86-bb24-4f51-9122-bd28b0eaf837]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:53 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 Jul 30 16:30:53 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26" returned: 0 in 0.502s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:53 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:53 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26 Jul 30 16:30:53 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:54 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-405d23e5-5d2e-4020-8d60-d63be6069e26" returned: 0 in 0.425s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-405d23e5-5d2e-4020-8d60-d63be6069e26" released by "delete_volume" :: held 1.005s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-6ac4f1af-f835-4e46-8966-00315f2663f2" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-6ac4f1af-f835-4e46-8966-00315f2663f2" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33a7b93-5035-4601-9627-69d111e13c1a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:54 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 Jul 30 16:30:54 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-445e2304-06ab-438c-8983-2a55fdd376da req-2e75dc4d-4f47-4724-af81-79fa0ef3a352 tempest-AttachVolumeTestJSON-144241327 None] Terminate volume connection completed successfully. Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-445e2304-06ab-438c-8983-2a55fdd376da req-2e75dc4d-4f47-4724-af81-79fa0ef3a352 tempest-AttachVolumeTestJSON-144241327 None] Deleting attachment 73d3c05c-ac88-4ede-945f-1b7daa008e75. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:30:54 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2" returned: 0 in 0.505s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:54 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2 Jul 30 16:30:54 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:55 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ac4f1af-f835-4e46-8966-00315f2663f2" returned: 0 in 0.325s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-6ac4f1af-f835-4e46-8966-00315f2663f2" released by "delete_volume" :: held 0.900s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['c2c25564-c5a3-451c-a29e-e95d73d6f881'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:55 devstack cinder-volume[88095]: WARNING cinder.quota [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-818035862 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-818035862, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['059ac590-e4ac-4e47-86d1-30bf142ebc74', 'cc097c67-2d4c-4e3e-8256-3cc706f930a0', '73bb41d7-6f37-42b1-b503-0a431614121a', 'c6cf9885-00b1-4269-a155-59c97c6696c5'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['f724d94f-ecde-4e40-bcdc-d8f6b64331f9', 'd2b16820-f3a1-44e0-9675-8fced40de988', '0220cb8d-bbfd-42d6-9956-c5531e316d6e', '1bfff516-47ea-4b35-94fb-14614c9aa655'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:55 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:30:55 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:56 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.511s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:56 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:30:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6756c087-b639-4b16-8d3c-08116ca2f070 tempest-GroupSnapshotsTest-503455304 None] Delete group completed successfully. Jul 30 16:30:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d76b4354-c580-48ab-8215-6c4ee3a26aa1 tempest-GroupSnapshotsTest-503455304 None] Group tempest-GroupSnapshotsTest-Group-479355264: creating Jul 30 16:30:56 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=144,cinder:SELECT=150,cinder:INSERT=35,cinder:DELETE=6 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:30:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d76b4354-c580-48ab-8215-6c4ee3a26aa1 tempest-GroupSnapshotsTest-503455304 None] Group tempest-GroupSnapshotsTest-Group-479355264: created successfully Jul 30 16:30:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d76b4354-c580-48ab-8215-6c4ee3a26aa1 tempest-GroupSnapshotsTest-503455304 None] Create group completed successfully. Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Flow 'volume_create_manager' (b555edc2-93c4-48ea-aa3e-ed17910738cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594de323-6980-4de2-b390-08a2de9a1403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594de323-6980-4de2-b390-08a2de9a1403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1898789140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37005294-a24a-441b-9f1f-14906e5583cc,host='devstack@QuobyteHD#QuobyteHD',id=3cbecb9f-feae-4d25-a883-97a32a78547c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ceda5f3246d4bb58a4d20447713cc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:58Z,use_quota=True,user_id='94a2a60b0db44f849aa523d4ff773feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aacfe420-42f7-4ee7-862d-700d73b3b1de),volume_type_id=aacfe420-42f7-4ee7-862d-700d73b3b1de)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4665364-188c-458f-95ad-6516a5f3e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4665364-188c-458f-95ad-6516a5f3e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688fddcc-da55-413e-a8b3-f570e4890982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688fddcc-da55-413e-a8b3-f570e4890982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cbecb9f-feae-4d25-a883-97a32a78547c', 'volume_name': 'volume-3cbecb9f-feae-4d25-a883-97a32a78547c', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c723d238-0461-4fa7-9a2c-a257d183a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c723d238-0461-4fa7-9a2c-a257d183a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879d3d7c-8ec0-449d-adf9-2f0d81fe14dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:58 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Volume 3cbecb9f-feae-4d25-a883-97a32a78547c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cbecb9f-feae-4d25-a883-97a32a78547c', 'volume_size': 1} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=37005294-a24a-441b-9f1f-14906e5583cc,created_at=2026-07-30T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1898789140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37005294-a24a-441b-9f1f-14906e5583cc,host='devstack@QuobyteHD#QuobyteHD',id=3cbecb9f-feae-4d25-a883-97a32a78547c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ceda5f3246d4bb58a4d20447713cc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:58Z,use_quota=True,user_id='94a2a60b0db44f849aa523d4ff773feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aacfe420-42f7-4ee7-862d-700d73b3b1de),volume_type_id=aacfe420-42f7-4ee7-862d-700d73b3b1de)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Creating volume 3cbecb9f-feae-4d25-a883-97a32a78547c {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:58 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:58 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c 1073741824 Jul 30 16:30:58 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:58 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Flow 'volume_create_manager' (9e148374-9686-47fc-961c-394a8fc89196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b9366c-82c9-41e6-85e4-389b2d77469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b9366c-82c9-41e6-85e4-389b2d77469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1343412344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b6ba8b-0800-4d98-acd9-19cfebcb7137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf9cc5ab1764ebe940bf36e7350e312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:59Z,use_quota=True,user_id='e727f6d827da4ce7a5d40357b7381c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e95ab3-565f-41b6-adab-1235659a2924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e95ab3-565f-41b6-adab-1235659a2924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb1ef38-0c74-4293-a9cd-e15f7ffa0333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb1ef38-0c74-4293-a9cd-e15f7ffa0333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b6ba8b-0800-4d98-acd9-19cfebcb7137', 'volume_name': 'volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6349f0-6a28-42ed-ad5e-f0251ca33ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6349f0-6a28-42ed-ad5e-f0251ca33ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b61907-078a-4437-bda2-985fbe184f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:59 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Volume 79b6ba8b-0800-4d98-acd9-19cfebcb7137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137', 'volume_size': 1} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:59 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c 1073741824" returned: 0 in 0.776s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:59 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c Jul 30 16:30:59 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:59 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c" returned: 0 in 0.265s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1343412344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b6ba8b-0800-4d98-acd9-19cfebcb7137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf9cc5ab1764ebe940bf36e7350e312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:30:59Z,use_quota=True,user_id='e727f6d827da4ce7a5d40357b7381c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Creating volume 79b6ba8b-0800-4d98-acd9-19cfebcb7137 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:30:59 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879d3d7c-8ec0-449d-adf9-2f0d81fe14dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cbecb9f-feae-4d25-a883-97a32a78547c', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0c79eb-1a61-4f9e-87e1-7ccec71edc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:30:59 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 1073741824 Jul 30 16:30:59 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:59 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Volume volume-3cbecb9f-feae-4d25-a883-97a32a78547c (3cbecb9f-feae-4d25-a883-97a32a78547c): created successfully Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0c79eb-1a61-4f9e-87e1-7ccec71edc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:30:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Flow 'volume_create_manager' (b555edc2-93c4-48ea-aa3e-ed17910738cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:30:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-291887ae-4cea-4ef3-882c-5a657f7b34bc tempest-GroupSnapshotsTest-503455304 None] Created volume successfully. Jul 30 16:31:00 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 1073741824" returned: 0 in 0.716s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:00 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 Jul 30 16:31:00 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:01 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137" returned: 0 in 0.516s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b61907-078a-4437-bda2-985fbe184f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cf586b-faa1-4e2f-8f96-881d03537941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:01 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Volume volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 (79b6ba8b-0800-4d98-acd9-19cfebcb7137): created successfully Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cf586b-faa1-4e2f-8f96-881d03537941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Flow 'volume_create_manager' (9e148374-9686-47fc-961c-394a8fc89196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9a6fa9f2-3d0d-461e-923c-cd1fc9294048 tempest-SnapshotMetadataTestJSON-2097262445 None] Created volume successfully. Jul 30 16:31:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] GroupSnapshot 6fa86c47-8a38-49f2-895a-6dcfae641893: creating. Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Group snapshot 6fa86c47-8a38-49f2-895a-6dcfae641893: creating. {{(pid=88095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Creating offline snapshot 7ba8d46a-ea1f-44dd-b647-225a5be913f5 of volume 3cbecb9f-feae-4d25-a883-97a32a78547c {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f38094-a200-4fe6-8256-0894651fc175]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:01 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c Jul 30 16:31:01 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:01 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c" returned: 0 in 0.428s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:01 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 1G Jul 30 16:31:01 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:02 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 1G" returned: 0 in 0.585s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cbecb9f-feae-4d25-a883-97a32a78547c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:02 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cbecb9f-feae-4d25-a883-97a32a78547c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 Jul 30 16:31:02 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:02 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cbecb9f-feae-4d25-a883-97a32a78547c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5" returned: 0 in 0.462s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:02 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:31:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:02 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 Jul 30 16:31:02 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:03 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5" returned: 0 in 0.410s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Acquiring lock "cinder-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Lock "cinder-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:03 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.info Jul 30 16:31:03 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Acquiring lock "cinder-quobyte-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Lock "cinder-quobyte-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9c9d25-362f-4208-b28e-0081d6e1db7d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:03 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 Jul 30 16:31:03 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:03 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.info" returned: 0 in 0.366s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:03 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:03 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.info Jul 30 16:31:03 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:03 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6" returned: 0 in 0.431s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:03 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6 Jul 30 16:31:03 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:04 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.info" returned: 0 in 0.298s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.743s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Creating offline snapshot d499def3-3332-4bdb-9f47-3ccc85781699 of volume 79b6ba8b-0800-4d98-acd9-19cfebcb7137 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fa2f8b-774e-4247-a772-7ce633cab8eb]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0c1fe24c-ba77-44ce-acdb-728742b26c05 tempest-GroupSnapshotsTest-503455304 None] group_snapshot 6fa86c47-8a38-49f2-895a-6dcfae641893: created successfully Jul 30 16:31:04 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 Jul 30 16:31:04 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:04 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6" returned: 0 in 0.296s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Lock "cinder-quobyte-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6" released by "delete_volume" :: held 0.804s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Created reservations ['0b12a5aa-db48-4067-b9a9-f1e77db39b26', '195a1762-4156-41b1-9871-c379a801499f', '73d54671-2f03-449d-a05f-951415331ebd', '9e7f3e0b-a9f2-42ea-a48e-b71e6a0892c1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:04 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:04 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:04 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137" returned: 0 in 0.492s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:04 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 1G Jul 30 16:31:04 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:04 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.297s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Deleted volume successfully. Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bc86db46-b4ee-42fd-beb3-e75bd9f7291a tempest-TaggedAttachmentsTest-58278690 None] Lock "cinder-c7b5475e-85d1-4b39-a2fe-26de71cd2ae6-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] group_snapshot 6fa86c47-8a38-49f2-895a-6dcfae641893: deleting Jul 30 16:31:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] group_snapshot 6fa86c47-8a38-49f2-895a-6dcfae641893: deleting {{(pid=88095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-3cbecb9f-feae-4d25-a883-97a32a78547c" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-3cbecb9f-feae-4d25-a883-97a32a78547c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-7ba8d46a-ea1f-44dd-b647-225a5be913f5" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-7ba8d46a-ea1f-44dd-b647-225a5be913f5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Deleting offline snapshot 7ba8d46a-ea1f-44dd-b647-225a5be913f5 of volume 3cbecb9f-feae-4d25-a883-97a32a78547c {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] snapshot_file for this snap is: volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b9f7e2-7053-41ff-a82b-d545b34c964c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:05 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 Jul 30 16:31:05 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:05 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 1G" returned: 0 in 0.799s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:05 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 Jul 30 16:31:05 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:05 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5" returned: 0 in 0.523s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cbecb9f-feae-4d25-a883-97a32a78547c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef56ea-a2f6-4f2a-ba2b-085c668d68bf]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:05 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c Jul 30 16:31:05 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:05 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699" returned: 0 in 0.464s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:05 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 is being set with open permissions: ugo+rw Jul 30 16:31:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:05 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 Jul 30 16:31:05 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:06 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c" returned: 0 in 0.409s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:06 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 Jul 30 16:31:06 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:06 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699" returned: 0 in 0.293s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:06 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.info Jul 30 16:31:06 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:06 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.info" returned: 0 in 0.337s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:06 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.info is being set with open permissions: ugo+rw Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:06 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.info Jul 30 16:31:06 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:06 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5" returned: 0 in 0.481s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:06 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5 Jul 30 16:31:06 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:06 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.info" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.796s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:06 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c.7ba8d46a-ea1f-44dd-b647-225a5be913f5" returned: 0 in 0.272s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:06 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cc669f2a-0a32-467b-b080-714e23a1af60 tempest-SnapshotMetadataTestJSON-2097262445 None] Create snapshot completed successfully Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-7ba8d46a-ea1f-44dd-b647-225a5be913f5" released by "_delete_snapshot" :: held 1.820s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-3cbecb9f-feae-4d25-a883-97a32a78547c" released by "delete_snapshot" :: held 1.867s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:06 devstack cinder-volume[88095]: WARNING cinder.quota [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1074290040 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1074290040, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:31:06 devstack cinder-volume[88095]: WARNING cinder.quota [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1074290040 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1074290040, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:31:07 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['38daf007-201a-4d21-b772-5b4b1867bec7', 'e11f8b94-6f6d-4339-a0f0-fea878402c86', '7bbb5da8-4fb0-4470-a379-d6888dafe6f0', '4d59dbe0-07e5-4657-9b7f-7b4ad346e3d9'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-71f2bbef-a5a5-4b5a-8aa3-033534c5fbe9 tempest-GroupSnapshotsTest-503455304 None] group_snapshot 6fa86c47-8a38-49f2-895a-6dcfae641893: deleted successfully Jul 30 16:31:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "cinder-quobyte-3cbecb9f-feae-4d25-a883-97a32a78547c" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-3cbecb9f-feae-4d25-a883-97a32a78547c" acquired by "delete_volume" :: waited 0.053s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:08 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0319e6de-8976-4815-acbb-b33400371029]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:08 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c Jul 30 16:31:08 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:08 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c" returned: 0 in 0.546s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:08 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c Jul 30 16:31:08 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "cinder-d499def3-3332-4bdb-9f47-3ccc85781699-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-d499def3-3332-4bdb-9f47-3ccc85781699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "cinder-quobyte-79b6ba8b-0800-4d98-acd9-19cfebcb7137" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-quobyte-79b6ba8b-0800-4d98-acd9-19cfebcb7137" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "cinder-quobyte-d499def3-3332-4bdb-9f47-3ccc85781699" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-quobyte-d499def3-3332-4bdb-9f47-3ccc85781699" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Deleting offline snapshot d499def3-3332-4bdb-9f47-3ccc85781699 of volume 79b6ba8b-0800-4d98-acd9-19cfebcb7137 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] snapshot_file for this snap is: volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:31:09 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e125e122-ec88-4a9d-afba-92c37e3c36a3]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cbecb9f-feae-4d25-a883-97a32a78547c" returned: 0 in 0.445s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Lock "cinder-quobyte-3cbecb9f-feae-4d25-a883-97a32a78547c" released by "delete_volume" :: held 1.110s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:09 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 Jul 30 16:31:09 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['86357f90-6d3b-430b-ab06-9d1829b9a5da'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:09 devstack cinder-volume[88095]: WARNING cinder.quota [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1074290040 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1074290040, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Created reservations ['38e24f6d-c009-47b1-afc0-7c28dcaaaf77', '90400f6b-d5f8-4f43-b06e-d28f0641a1b0', '8b2444b8-137d-4c02-8f39-301040b142b2', '4227b454-0e4c-4781-ae3a-daf25cd64637'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:09 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699" returned: 0 in 0.577s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:31:09 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:09 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38ab0e7-102c-467b-ad07-62b962cdf466]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:10 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 Jul 30 16:31:10 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:10 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.326s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:10 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-186419ec-17b2-4b74-bd35-a2ae3ea041c1 tempest-GroupSnapshotsTest-503455304 None] Delete group completed successfully. Jul 30 16:31:10 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137" returned: 0 in 0.469s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:10 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 Jul 30 16:31:10 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:10 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699" returned: 0 in 0.422s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:10 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699 Jul 30 16:31:10 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:11 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137.d499def3-3332-4bdb-9f47-3ccc85781699" returned: 0 in 0.363s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-quobyte-d499def3-3332-4bdb-9f47-3ccc85781699" released by "_delete_snapshot" :: held 2.011s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-quobyte-79b6ba8b-0800-4d98-acd9-19cfebcb7137" released by "delete_snapshot" :: held 2.066s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:11 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Created reservations ['5c9392ef-8331-4ef7-b6b1-2ffa9e817dc3', '17d3c006-4fcd-435d-b81d-48e014215e62', 'd4b29e3f-e772-40e5-a009-722541d421da', '25d94704-3a50-4eac-8612-3e4e4e663d3a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Delete snapshot completed successfully. Jul 30 16:31:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b65d485b-d1b0-47ba-851e-829fad3c29da tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-d499def3-3332-4bdb-9f47-3ccc85781699-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "cinder-79b6ba8b-0800-4d98-acd9-19cfebcb7137-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-79b6ba8b-0800-4d98-acd9-19cfebcb7137-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "cinder-quobyte-79b6ba8b-0800-4d98-acd9-19cfebcb7137" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-quobyte-79b6ba8b-0800-4d98-acd9-19cfebcb7137" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:12 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0c050-0f94-4b2a-9591-892434210753]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:12 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 Jul 30 16:31:12 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:13 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137" returned: 0 in 0.611s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:13 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137 Jul 30 16:31:13 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:13 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-79b6ba8b-0800-4d98-acd9-19cfebcb7137" returned: 0 in 0.558s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-quobyte-79b6ba8b-0800-4d98-acd9-19cfebcb7137" released by "delete_volume" :: held 1.260s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:13 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Created reservations ['cc85ec8e-c00c-4956-98f7-1a0fdb33d973', '7e3c7092-40e7-4793-bb30-8d86a9224749', '597ebc17-84dc-4c01-a62d-4c26c5d11f5d', 'ff468361-d411-484c-a189-de4f4feb34a1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:14 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:14 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:14 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.296s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Deleted volume successfully. Jul 30 16:31:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3b7f84b4-dbf0-4faa-97d0-edd6c47e925e tempest-SnapshotMetadataTestJSON-2097262445 None] Lock "cinder-79b6ba8b-0800-4d98-acd9-19cfebcb7137-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Flow 'volume_create_manager' (8fb8b498-4595-450a-b5f3-f6d391c04ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c84fa1-4fd1-425b-8a76-eda088421f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c84fa1-4fd1-425b-8a76-eda088421f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1413327402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7aca5f-709b-4ca0-9188-4db1d98fb2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdad4e12b7340299a5b2fe25213b20a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:20Z,use_quota=True,user_id='1b65142a10bb478da85e72b523f68510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274cf5fa-7b9a-44fb-925e-235a5100dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274cf5fa-7b9a-44fb-925e-235a5100dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085bb124-5cd5-4548-8afa-747fe00b0be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085bb124-5cd5-4548-8afa-747fe00b0be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7aca5f-709b-4ca0-9188-4db1d98fb2cc', 'volume_name': 'volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9a3b64-109f-46ec-8e64-d64c24303035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9a3b64-109f-46ec-8e64-d64c24303035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e28f30c-7a78-4ce2-a2c7-0e9b37895669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:19 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Volume af7aca5f-709b-4ca0-9188-4db1d98fb2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc', 'volume_size': 1} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1413327402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7aca5f-709b-4ca0-9188-4db1d98fb2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdad4e12b7340299a5b2fe25213b20a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:20Z,use_quota=True,user_id='1b65142a10bb478da85e72b523f68510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Creating volume af7aca5f-709b-4ca0-9188-4db1d98fb2cc {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:31:19 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:31:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:19 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc 1073741824 Jul 30 16:31:19 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:20 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc 1073741824" returned: 0 in 0.502s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:20 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc Jul 30 16:31:20 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:20 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc" returned: 0 in 0.297s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e28f30c-7a78-4ce2-a2c7-0e9b37895669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e55d6b-ab2b-42b7-854f-214ea3240178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:20 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Volume volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc (af7aca5f-709b-4ca0-9188-4db1d98fb2cc): created successfully Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e55d6b-ab2b-42b7-854f-214ea3240178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Flow 'volume_create_manager' (8fb8b498-4595-450a-b5f3-f6d391c04ff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:20 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ae6334a5-66e8-44f9-8c4c-a20887285a6d tempest-AbsoluteLimitsTests-151953043 None] Created volume successfully. Jul 30 16:31:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Acquiring lock "cinder-af7aca5f-709b-4ca0-9188-4db1d98fb2cc-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Lock "cinder-af7aca5f-709b-4ca0-9188-4db1d98fb2cc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Acquiring lock "cinder-quobyte-af7aca5f-709b-4ca0-9188-4db1d98fb2cc" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Lock "cinder-quobyte-af7aca5f-709b-4ca0-9188-4db1d98fb2cc" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:22 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6498bde6-e0e6-4090-ba8c-4ebe46fc7379]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:22 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc Jul 30 16:31:22 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:22 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc" returned: 0 in 0.466s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:22 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc Jul 30 16:31:22 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:23 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-af7aca5f-709b-4ca0-9188-4db1d98fb2cc" returned: 0 in 0.322s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Lock "cinder-quobyte-af7aca5f-709b-4ca0-9188-4db1d98fb2cc" released by "delete_volume" :: held 0.865s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Created reservations ['4a3028d3-9168-464a-abc6-60ffaf6ccdec', '574832e0-244f-4e2f-9d10-dca99d78ced3', '8c551737-916d-481d-aabd-20615963747e', '57ec1f51-9de9-41f0-a822-7d06d59dfbbd'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=136,cinder:UPDATE=150,cinder:INSERT=30,cinder:DELETE=5 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:23 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:23 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:23 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.407s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:23 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Deleted volume successfully. Jul 30 16:31:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35849848-3814-40f5-a65f-3c747db108f4 tempest-AbsoluteLimitsTests-151953043 None] Lock "cinder-af7aca5f-709b-4ca0-9188-4db1d98fb2cc-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:33 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=55,cinder:UPDATE=62,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Flow 'volume_create_manager' (ae163b53-32a0-4d02-9942-a4b0125809b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b91cfc-8826-4962-b5b3-b654c0c5afb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b91cfc-8826-4962-b5b3-b654c0c5afb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2095274339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b029a3-a64b-4443-a620-6586c543961f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f453d34d407849488836ab744a7c5b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:34Z,use_quota=True,user_id='aceb2092abf145fe8807ea2c575979f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f681a786-eb41-4ad4-801e-eb553112620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f681a786-eb41-4ad4-801e-eb553112620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d858670-64d9-41b1-96a9-12baf8c5bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d858670-64d9-41b1-96a9-12baf8c5bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b029a3-a64b-4443-a620-6586c543961f', 'volume_name': 'volume-a3b029a3-a64b-4443-a620-6586c543961f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fc94bc-ac8b-474c-9073-879dcf203409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fc94bc-ac8b-474c-9073-879dcf203409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321af90c-25bd-4d08-8cc2-570ae9eefc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:34 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Volume a3b029a3-a64b-4443-a620-6586c543961f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b029a3-a64b-4443-a620-6586c543961f', 'volume_size': 1} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2095274339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b029a3-a64b-4443-a620-6586c543961f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f453d34d407849488836ab744a7c5b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:34Z,use_quota=True,user_id='aceb2092abf145fe8807ea2c575979f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Creating volume a3b029a3-a64b-4443-a620-6586c543961f {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:31:34 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:31:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:34 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f 1073741824 Jul 30 16:31:34 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:35 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f 1073741824" returned: 0 in 0.588s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:35 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f Jul 30 16:31:35 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Flow 'volume_create_manager' (af45ac0c-7e33-4342-88c3-5de139d3a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef3288d-52ba-4a07-8bf8-3ddf28563ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef3288d-52ba-4a07-8bf8-3ddf28563ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1773090762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2139d9f2-8a80-46d2-99a0-e13b88355558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f84fbaf7f429ab9c505e2627ee368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:35Z,use_quota=True,user_id='98e19267c8bc4553ae5f282dafa7b54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3929841d-955f-4f8b-a2f6-f7f520f9d2c9),volume_type_id=3929841d-955f-4f8b-a2f6-f7f520f9d2c9)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1851e6f-6cdd-49e8-84e6-934f057e1cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1851e6f-6cdd-49e8-84e6-934f057e1cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3306d1-58f1-442e-8a73-bcbcc66b1044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3306d1-58f1-442e-8a73-bcbcc66b1044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2139d9f2-8a80-46d2-99a0-e13b88355558', 'volume_name': 'volume-2139d9f2-8a80-46d2-99a0-e13b88355558', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e8c1d2-8dc3-49c3-af6f-eb974f801952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e8c1d2-8dc3-49c3-af6f-eb974f801952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fffef1a-d3b8-4295-9e77-3e862a784abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Volume 2139d9f2-8a80-46d2-99a0-e13b88355558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2139d9f2-8a80-46d2-99a0-e13b88355558', 'volume_size': 1} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:35 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f" returned: 0 in 0.288s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1773090762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2139d9f2-8a80-46d2-99a0-e13b88355558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f84fbaf7f429ab9c505e2627ee368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:35Z,use_quota=True,user_id='98e19267c8bc4553ae5f282dafa7b54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3929841d-955f-4f8b-a2f6-f7f520f9d2c9),volume_type_id=3929841d-955f-4f8b-a2f6-f7f520f9d2c9)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Creating volume 2139d9f2-8a80-46d2-99a0-e13b88355558 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:31:35 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321af90c-25bd-4d08-8cc2-570ae9eefc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b029a3-a64b-4443-a620-6586c543961f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:35 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 1073741824 Jul 30 16:31:35 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e9319f-d828-4398-8bc6-9b753ab55b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Volume volume-a3b029a3-a64b-4443-a620-6586c543961f (a3b029a3-a64b-4443-a620-6586c543961f): created successfully Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e9319f-d828-4398-8bc6-9b753ab55b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Flow 'volume_create_manager' (ae163b53-32a0-4d02-9942-a4b0125809b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1afb7e08-7a1a-431b-ab92-73c3bae0e57e tempest-VolumesTransfersV355Test-285840597 None] Created volume successfully. Jul 30 16:31:36 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 1073741824" returned: 0 in 0.539s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:36 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 Jul 30 16:31:36 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:36 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558" returned: 0 in 0.304s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fffef1a-d3b8-4295-9e77-3e862a784abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2139d9f2-8a80-46d2-99a0-e13b88355558', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b7c1f0-6391-42f4-80f1-dda55b191892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:36 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Volume volume-2139d9f2-8a80-46d2-99a0-e13b88355558 (2139d9f2-8a80-46d2-99a0-e13b88355558): created successfully Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b7c1f0-6391-42f4-80f1-dda55b191892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Flow 'volume_create_manager' (af45ac0c-7e33-4342-88c3-5de139d3a451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f9d2aec3-7e5f-4786-a18e-51936927c89b tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Created volume successfully. Jul 30 16:31:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c2c2dc79-a1af-4641-afbc-2d6b7faa0a90 tempest-VolumesTransfersV355Test-76910377 None] Transfer volume completed successfully. Jul 30 16:31:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:37 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:37 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:38 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:38 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c6c92c5e-3a9e-40ef-aaf6-d7e2922d7357 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Retype volume completed successfully. Jul 30 16:31:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Acquiring lock "cinder-a3b029a3-a64b-4443-a620-6586c543961f-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Lock "cinder-a3b029a3-a64b-4443-a620-6586c543961f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Acquiring lock "cinder-quobyte-a3b029a3-a64b-4443-a620-6586c543961f" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Lock "cinder-quobyte-a3b029a3-a64b-4443-a620-6586c543961f" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:38 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[64276ffd-df24-4fd8-b431-b3af36644f05]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:38 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f Jul 30 16:31:38 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:39 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f" returned: 0 in 0.552s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:39 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f Jul 30 16:31:39 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Acquiring lock "cinder-2139d9f2-8a80-46d2-99a0-e13b88355558-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "cinder-2139d9f2-8a80-46d2-99a0-e13b88355558-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:39 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a3b029a3-a64b-4443-a620-6586c543961f" returned: 0 in 0.496s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Acquiring lock "cinder-quobyte-2139d9f2-8a80-46d2-99a0-e13b88355558" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Lock "cinder-quobyte-a3b029a3-a64b-4443-a620-6586c543961f" released by "delete_volume" :: held 1.130s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "cinder-quobyte-2139d9f2-8a80-46d2-99a0-e13b88355558" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c5d70-c3e4-48b1-a7dd-6e21153293e0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Created reservations ['1b58c2cd-e056-448e-be30-387e23c9422b', '35f59e96-e10e-4b96-9bc0-0887050eedb8', 'ef60f486-e3b1-400c-b9e9-59661094c758', '0d868c54-c88c-4c75-b410-9c4c2b903d12'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:39 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 Jul 30 16:31:39 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:39 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:39 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:40 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.602s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:40 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:40 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Deleted volume successfully. Jul 30 16:31:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409c2c1f-4d0e-42e5-82c7-a2e49fb2663e tempest-VolumesTransfersV355Test-1592700622 None] Lock "cinder-a3b029a3-a64b-4443-a620-6586c543961f-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:40 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558" returned: 0 in 0.930s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:40 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558 Jul 30 16:31:40 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:41 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2139d9f2-8a80-46d2-99a0-e13b88355558" returned: 0 in 0.590s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "cinder-quobyte-2139d9f2-8a80-46d2-99a0-e13b88355558" released by "delete_volume" :: held 1.586s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:41 devstack cinder-volume[88095]: WARNING cinder.quota [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:31:41 devstack cinder-volume[88095]: WARNING cinder.quota [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Created reservations ['d10531f7-e991-4fb6-86f4-97b18f3e0006', '669d9531-736b-46e7-af9c-0c5fa0b55fa7', '4dfc511f-6a27-4f83-a050-9506e81aeff4', '5f68b076-adcb-4fbf-a096-740adf30fe51'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:41 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:41 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Flow 'volume_create_manager' (0b0dac75-5297-482f-82bc-ba73d0a848f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d94d35-f839-4757-903a-4e12b0ce24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d94d35-f839-4757-903a-4e12b0ce24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-398391012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4139772-f164-4389-8851-86062dffb221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f453d34d407849488836ab744a7c5b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:42Z,use_quota=True,user_id='aceb2092abf145fe8807ea2c575979f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96769d0-84dc-494b-a1be-178a07721a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96769d0-84dc-494b-a1be-178a07721a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a788a3-b1b5-4074-b919-8db6d9827d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a788a3-b1b5-4074-b919-8db6d9827d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4139772-f164-4389-8851-86062dffb221', 'volume_name': 'volume-d4139772-f164-4389-8851-86062dffb221', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff15144a-2d9a-4298-8272-08bbc0ee1a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:41 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff15144a-2d9a-4298-8272-08bbc0ee1a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c2a50e-a324-49ae-82ee-bae6933bc7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Volume d4139772-f164-4389-8851-86062dffb221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4139772-f164-4389-8851-86062dffb221', 'volume_size': 1} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-398391012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4139772-f164-4389-8851-86062dffb221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f453d34d407849488836ab744a7c5b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:42Z,use_quota=True,user_id='aceb2092abf145fe8807ea2c575979f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Creating volume d4139772-f164-4389-8851-86062dffb221 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:31:41 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.479s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:41 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:41 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Deleted volume successfully. Jul 30 16:31:41 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 1073741824 Jul 30 16:31:41 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-375bf668-6e9e-4d74-8d63-a85e783957a0 tempest-VolumeRetypeWithoutMigrationTest-298208306 None] Lock "cinder-2139d9f2-8a80-46d2-99a0-e13b88355558-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:42 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 1073741824" returned: 0 in 0.791s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:42 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 Jul 30 16:31:42 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:43 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221" returned: 0 in 0.521s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:31:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c2a50e-a324-49ae-82ee-bae6933bc7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4139772-f164-4389-8851-86062dffb221', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4454a31-e8fe-4057-bfef-b813f8aa68da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:43 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Volume volume-d4139772-f164-4389-8851-86062dffb221 (d4139772-f164-4389-8851-86062dffb221): created successfully Jul 30 16:31:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4454a31-e8fe-4057-bfef-b813f8aa68da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Flow 'volume_create_manager' (0b0dac75-5297-482f-82bc-ba73d0a848f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0455937d-7227-4c82-acd3-83d4f70f96b0 tempest-VolumesTransfersV355Test-285840597 None] Created volume successfully. Jul 30 16:31:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Acquiring lock "cinder-d4139772-f164-4389-8851-86062dffb221-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Lock "cinder-d4139772-f164-4389-8851-86062dffb221-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Acquiring lock "cinder-quobyte-d4139772-f164-4389-8851-86062dffb221" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Lock "cinder-quobyte-d4139772-f164-4389-8851-86062dffb221" acquired by "delete_volume" :: waited 0.031s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d7cdfd-4d87-4e40-b9ae-068e9483908c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:45 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 Jul 30 16:31:45 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:45 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221" returned: 0 in 0.742s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:45 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221 Jul 30 16:31:45 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:46 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4139772-f164-4389-8851-86062dffb221" returned: 0 in 0.431s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Lock "cinder-quobyte-d4139772-f164-4389-8851-86062dffb221" released by "delete_volume" :: held 1.253s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Created reservations ['f08dc1cd-77d5-4eff-96e1-339c2da75dfa', '530b8cd9-b7b8-49e7-a0d2-dc9f9558550c', '2dd3ea20-8f51-45a5-a93d-dbc85fd66f34', 'a3f671b3-d85b-402b-9909-a31807f04970'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:46 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:46 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:46 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.562s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:46 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Deleted volume successfully. Jul 30 16:31:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6d6a83d8-d71f-4cb9-9f11-a3ba9c8fc1b5 tempest-VolumesTransfersV355Test-1592700622 None] Lock "cinder-d4139772-f164-4389-8851-86062dffb221-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:31:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:47 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:47 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:48 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.799s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:48 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:48 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:31:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 8 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:31:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Flow 'volume_create_manager' (7cdc28b2-3207-47ab-a8f9-1042bd1617b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822eb2c3-2ed8-44ec-a6b9-a398ef20ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822eb2c3-2ed8-44ec-a6b9-a398ef20ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1460506143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265bdb47-68d8-4b14-83fb-dd6a3976ddbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc66d3abbd1746b2bc0349596d0436b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:55Z,use_quota=True,user_id='c4d8f556d4814b49be1ab17fdeff235a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27431cf9-b55f-4833-8939-5c5bb3485962),volume_type_id=27431cf9-b55f-4833-8939-5c5bb3485962)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfda801-05c5-44e6-87f2-8ba49a8c28a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfda801-05c5-44e6-87f2-8ba49a8c28a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236d8132-98f2-490b-8bfe-c7d4124f65cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236d8132-98f2-490b-8bfe-c7d4124f65cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265bdb47-68d8-4b14-83fb-dd6a3976ddbb', 'volume_name': 'volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0dee1c-6754-4e7d-abe2-56ec9359f136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0dee1c-6754-4e7d-abe2-56ec9359f136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe12c595-a2f7-44c0-814d-48d680e754e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:54 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Volume 265bdb47-68d8-4b14-83fb-dd6a3976ddbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb', 'volume_size': 1} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1460506143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265bdb47-68d8-4b14-83fb-dd6a3976ddbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc66d3abbd1746b2bc0349596d0436b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:55Z,use_quota=True,user_id='c4d8f556d4814b49be1ab17fdeff235a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27431cf9-b55f-4833-8939-5c5bb3485962),volume_type_id=27431cf9-b55f-4833-8939-5c5bb3485962)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Creating volume 265bdb47-68d8-4b14-83fb-dd6a3976ddbb {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:31:54 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:31:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:54 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb 1073741824 Jul 30 16:31:54 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:55 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb 1073741824" returned: 0 in 0.532s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:55 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb Jul 30 16:31:55 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:55 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb" returned: 0 in 0.347s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe12c595-a2f7-44c0-814d-48d680e754e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0c432f-5e71-43dc-b431-73bb86cfba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:55 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Volume volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb (265bdb47-68d8-4b14-83fb-dd6a3976ddbb): created successfully Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0c432f-5e71-43dc-b431-73bb86cfba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Flow 'volume_create_manager' (7cdc28b2-3207-47ab-a8f9-1042bd1617b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:55 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-58824ed2-6d7c-43bc-9bc6-a53a1b34c68f tempest-VolumeTypesAccessTest-1901374290 None] Created volume successfully. Jul 30 16:31:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Acquiring lock "cinder-265bdb47-68d8-4b14-83fb-dd6a3976ddbb-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Lock "cinder-265bdb47-68d8-4b14-83fb-dd6a3976ddbb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Acquiring lock "cinder-quobyte-265bdb47-68d8-4b14-83fb-dd6a3976ddbb" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:31:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Lock "cinder-quobyte-265bdb47-68d8-4b14-83fb-dd6a3976ddbb" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:31:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef9837e-2503-46bf-a778-2445efd7f246]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:31:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:57 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb Jul 30 16:31:57 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:57 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb" returned: 0 in 0.436s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:57 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb Jul 30 16:31:57 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:57 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-265bdb47-68d8-4b14-83fb-dd6a3976ddbb" returned: 0 in 0.275s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Lock "cinder-quobyte-265bdb47-68d8-4b14-83fb-dd6a3976ddbb" released by "delete_volume" :: held 0.775s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:57 devstack cinder-volume[88095]: WARNING cinder.quota [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-501127919 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-501127919, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:31:57 devstack cinder-volume[88095]: WARNING cinder.quota [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-501127919 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-501127919, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Created reservations ['aded72af-7ce4-44dd-ba5b-50831d672354', '6681b773-721e-46f9-97d7-fd488a64b3b4', 'eac4b047-2d15-4529-80b5-d2f0d9de83dc', '50b2392d-cf86-43aa-beb4-891defee94b3'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:57 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:31:57 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:58 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.358s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Deleted volume successfully. Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2351c251-5a47-412f-babc-65d6e8f934c6 tempest-VolumeTypesAccessTest-1901374290 None] Lock "cinder-265bdb47-68d8-4b14-83fb-dd6a3976ddbb-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Flow 'volume_create_manager' (2063755b-56f0-4294-8d43-a38d715a2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698a0c63-f67b-4fcd-8516-d47a232843ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698a0c63-f67b-4fcd-8516-d47a232843ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1818457874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2721a865e9d4d64b755681a10e630d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:59Z,use_quota=True,user_id='6e6d841de8914899950f306d39ff1b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c858784-b422-44b3-8a15-ebeea5f5ad15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c858784-b422-44b3-8a15-ebeea5f5ad15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c9666b-446a-414d-98ca-34e998ced682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c9666b-446a-414d-98ca-34e998ced682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55', 'volume_name': 'volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8e64c0-bc2d-4aeb-8c18-809cf40ec06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8e64c0-bc2d-4aeb-8c18-809cf40ec06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb3d192-31ed-45cb-b206-fd3542e2f0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:58 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Volume b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55', 'volume_size': 1} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1818457874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2721a865e9d4d64b755681a10e630d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:31:59Z,use_quota=True,user_id='6e6d841de8914899950f306d39ff1b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Creating volume b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:31:58 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:31:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:58 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 1073741824 Jul 30 16:31:58 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:59 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 1073741824" returned: 0 in 0.487s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:59 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 Jul 30 16:31:59 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:59 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55" returned: 0 in 0.300s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb3d192-31ed-45cb-b206-fd3542e2f0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25df6ec5-4238-4246-a0c4-a2ea016dfd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:31:59 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Volume volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 (b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55): created successfully Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25df6ec5-4238-4246-a0c4-a2ea016dfd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:31:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Flow 'volume_create_manager' (2063755b-56f0-4294-8d43-a38d715a2fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:31:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-91efb247-9c47-4f85-895b-ddbe67d605a1 tempest-VolumesTransfersV357Test-1352097218 None] Created volume successfully. Jul 30 16:32:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4e9ee225-7165-4c2d-898b-fdd6dfacf0d8 tempest-VolumesTransfersV357Test-1626529957 None] Transfer volume completed successfully. Jul 30 16:32:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Acquiring lock "cinder-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Lock "cinder-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Acquiring lock "cinder-quobyte-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Lock "cinder-quobyte-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd3e348-9c40-4438-8a25-5221ee353bc4]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:02 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 Jul 30 16:32:02 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:02 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:03 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55 Jul 30 16:32:03 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:03 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55" returned: 0 in 0.244s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Lock "cinder-quobyte-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55" released by "delete_volume" :: held 0.680s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Created reservations ['d2e01b4b-24e1-4102-ad47-f09a9666bb4b', '91853267-baa2-407f-883e-36ca9ac632cd', '4edb06bb-0b25-4da6-b5f4-82d2ea829899', '220ae290-ca8a-4780-a7fe-07e307e77c93'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:03 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:03 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:03 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.260s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:03 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Deleted volume successfully. Jul 30 16:32:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a533f47e-1d6a-4b3c-ad9f-b22c5d909788 tempest-VolumesTransfersV357Test-1163182824 None] Lock "cinder-b0aaed0f-3ff0-4c2b-87f6-6172ddaa8f55-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Flow 'volume_create_manager' (0ff48daa-63cc-42f3-b4f5-89246ea48320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a83719d-2491-4fa1-96de-a3974e01247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a83719d-2491-4fa1-96de-a3974e01247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-750938581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c156c3a3-0240-4440-9fb2-73df3433fc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2721a865e9d4d64b755681a10e630d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:04Z,use_quota=True,user_id='6e6d841de8914899950f306d39ff1b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c0730f-1ee1-4003-bd9f-247a44d1f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c0730f-1ee1-4003-bd9f-247a44d1f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf07787-f37c-4799-ba69-27759bc31b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf07787-f37c-4799-ba69-27759bc31b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c156c3a3-0240-4440-9fb2-73df3433fc65', 'volume_name': 'volume-c156c3a3-0240-4440-9fb2-73df3433fc65', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e52e10-29d2-4bd9-88c7-4adda77ca441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e52e10-29d2-4bd9-88c7-4adda77ca441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b5d229-9f4e-4e04-aa11-59b39d07f957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:04 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Volume c156c3a3-0240-4440-9fb2-73df3433fc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c156c3a3-0240-4440-9fb2-73df3433fc65', 'volume_size': 1} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-750938581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c156c3a3-0240-4440-9fb2-73df3433fc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2721a865e9d4d64b755681a10e630d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:04Z,use_quota=True,user_id='6e6d841de8914899950f306d39ff1b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Creating volume c156c3a3-0240-4440-9fb2-73df3433fc65 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:04 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:04 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 1073741824 Jul 30 16:32:04 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:04 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 1073741824" returned: 0 in 0.497s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:04 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 Jul 30 16:32:04 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:05 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65" returned: 0 in 0.278s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:32:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b5d229-9f4e-4e04-aa11-59b39d07f957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c156c3a3-0240-4440-9fb2-73df3433fc65', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3506c8e7-4420-4b00-8349-83209daddeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:05 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Volume volume-c156c3a3-0240-4440-9fb2-73df3433fc65 (c156c3a3-0240-4440-9fb2-73df3433fc65): created successfully Jul 30 16:32:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3506c8e7-4420-4b00-8349-83209daddeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Flow 'volume_create_manager' (0ff48daa-63cc-42f3-b4f5-89246ea48320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5844e54e-3a04-40b2-a478-151830b57f63 tempest-VolumesTransfersV357Test-1352097218 None] Created volume successfully. Jul 30 16:32:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Acquiring lock "cinder-c156c3a3-0240-4440-9fb2-73df3433fc65-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Lock "cinder-c156c3a3-0240-4440-9fb2-73df3433fc65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Acquiring lock "cinder-quobyte-c156c3a3-0240-4440-9fb2-73df3433fc65" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Lock "cinder-quobyte-c156c3a3-0240-4440-9fb2-73df3433fc65" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:06 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52b2aa2-b4d5-4efa-a48c-b9423d03376a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:06 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 Jul 30 16:32:06 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:07 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65" returned: 0 in 0.390s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:07 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65 Jul 30 16:32:07 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:07 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c156c3a3-0240-4440-9fb2-73df3433fc65" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Lock "cinder-quobyte-c156c3a3-0240-4440-9fb2-73df3433fc65" released by "delete_volume" :: held 0.714s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Created reservations ['f6dd5ff1-ebb0-4928-879f-b392a6900670', 'b3d1a2eb-1a35-4939-b1e4-ed545eb81e19', '40ca6f85-39aa-460c-b33a-3bec3855081f', 'b4dcde9a-f15b-44da-8bb3-148e18e7e8f0'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:07 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:07 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:07 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Deleted volume successfully. Jul 30 16:32:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f50bb6a8-7112-4223-98f5-5b40c0d9ea5a tempest-VolumesTransfersV357Test-1163182824 None] Lock "cinder-c156c3a3-0240-4440-9fb2-73df3433fc65-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Flow 'volume_create_manager' (2fd17b06-2915-4746-b265-281c07cf2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a2cf8-6dd8-46d5-862c-5e521b936540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a2cf8-6dd8-46d5-862c-5e521b936540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-202577716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3c9e64-668f-4e9d-8421-135a94f6a3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b246f98bfb9439cbd6ae859c1f04149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:11Z,use_quota=True,user_id='c0a8d1ae65af4924b592f515fe135576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6def514-083a-4460-8a95-6f4500c2fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6def514-083a-4460-8a95-6f4500c2fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46138606-1969-429b-a8fc-6c4339b7e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46138606-1969-429b-a8fc-6c4339b7e609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3c9e64-668f-4e9d-8421-135a94f6a3e2', 'volume_name': 'volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a0f42d-3d62-464e-a75f-20242d313d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a0f42d-3d62-464e-a75f-20242d313d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b13d641-3185-4ff6-82b6-c233ce588f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:10 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Volume fd3c9e64-668f-4e9d-8421-135a94f6a3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2', 'volume_size': 1} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-202577716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3c9e64-668f-4e9d-8421-135a94f6a3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b246f98bfb9439cbd6ae859c1f04149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:11Z,use_quota=True,user_id='c0a8d1ae65af4924b592f515fe135576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Creating volume fd3c9e64-668f-4e9d-8421-135a94f6a3e2 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:10 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:10 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 1073741824 Jul 30 16:32:10 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:11 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 1073741824" returned: 0 in 0.642s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:11 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 Jul 30 16:32:11 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:11 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2" returned: 0 in 0.332s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b13d641-3185-4ff6-82b6-c233ce588f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cebb237-9fff-4b68-be00-b5bc050e65eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:11 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Volume volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 (fd3c9e64-668f-4e9d-8421-135a94f6a3e2): created successfully Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cebb237-9fff-4b68-be00-b5bc050e65eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Flow 'volume_create_manager' (2fd17b06-2915-4746-b265-281c07cf2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-46d28a3b-5108-42b8-8b35-8c223d7a52e4 tempest-AttachVolumeTestJSON-144241327 None] Created volume successfully. Jul 30 16:32:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-92a06336-a590-4a0a-ac8d-1021dadc5ede req-d12c15aa-e8bd-45e6-bb63-06fa6b7afe62 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-92a06336-a590-4a0a-ac8d-1021dadc5ede req-d12c15aa-e8bd-45e6-bb63-06fa6b7afe62 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-92a06336-a590-4a0a-ac8d-1021dadc5ede req-d12c15aa-e8bd-45e6-bb63-06fa6b7afe62 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-92a06336-a590-4a0a-ac8d-1021dadc5ede req-d12c15aa-e8bd-45e6-bb63-06fa6b7afe62 tempest-AttachVolumeTestJSON-144241327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4685a969-be5e-43ae-b5b2-3682881349b7', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:32:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-92a06336-a590-4a0a-ac8d-1021dadc5ede req-d12c15aa-e8bd-45e6-bb63-06fa6b7afe62 tempest-AttachVolumeTestJSON-144241327 None] attachment_update completed successfully. Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Flow 'volume_create_manager' (21297eec-7c5a-4835-bc58-c5b05acb9c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d531c935-cd5d-47f4-bba2-e29d6b04f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d531c935-cd5d-47f4-bba2-e29d6b04f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-553377531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec02579-a68d-4aef-8070-95de214fbe23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764910011abd40d094f033a70b78c843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:14Z,use_quota=True,user_id='075096012bd64cbebe60abf8a9bd91ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67921ce9-bb78-401e-90ce-0c29cd4182e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67921ce9-bb78-401e-90ce-0c29cd4182e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11cff20-38b7-4c26-a28a-aecdb15fd9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11cff20-38b7-4c26-a28a-aecdb15fd9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec02579-a68d-4aef-8070-95de214fbe23', 'volume_name': 'volume-7ec02579-a68d-4aef-8070-95de214fbe23', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600c08b8-bd5a-4404-9699-e1b7139d6477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600c08b8-bd5a-4404-9699-e1b7139d6477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974b4c1e-0e42-4249-a736-0d38e4ba2e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:14 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Volume 7ec02579-a68d-4aef-8070-95de214fbe23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec02579-a68d-4aef-8070-95de214fbe23', 'volume_size': 1} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-553377531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec02579-a68d-4aef-8070-95de214fbe23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764910011abd40d094f033a70b78c843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:14Z,use_quota=True,user_id='075096012bd64cbebe60abf8a9bd91ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Creating volume 7ec02579-a68d-4aef-8070-95de214fbe23 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:14 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:14 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 1073741824 Jul 30 16:32:14 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:15 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 1073741824" returned: 0 in 0.756s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:15 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 Jul 30 16:32:15 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Flow 'volume_create_manager' (642fd03e-7fbc-4bb8-9110-b76ca9b40b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:15 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87eb5a2f-d351-426a-b670-b49fe1d84c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23" returned: 0 in 0.476s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87eb5a2f-d351-426a-b670-b49fe1d84c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-499104839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1548d7d2-7d69-4c44-b461-79632a79f1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4af868a549d439e8eced35822b40167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:16Z,use_quota=True,user_id='514badf4a04e486790069ada8b4b18f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be431d6c-08dd-4321-9f41-ff57ff755eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be431d6c-08dd-4321-9f41-ff57ff755eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7e2a52-3a69-4584-aa61-8eb18c08fd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7e2a52-3a69-4584-aa61-8eb18c08fd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1548d7d2-7d69-4c44-b461-79632a79f1ca', 'volume_name': 'volume-1548d7d2-7d69-4c44-b461-79632a79f1ca', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd3bdce-9c9d-48d1-853e-d33bc20388bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd3bdce-9c9d-48d1-853e-d33bc20388bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de22574d-3635-40f2-8522-e2b2c1fc852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:15 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Volume 1548d7d2-7d69-4c44-b461-79632a79f1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1548d7d2-7d69-4c44-b461-79632a79f1ca', 'volume_size': 1} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-499104839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1548d7d2-7d69-4c44-b461-79632a79f1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4af868a549d439e8eced35822b40167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:16Z,use_quota=True,user_id='514badf4a04e486790069ada8b4b18f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Creating volume 1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:15 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974b4c1e-0e42-4249-a736-0d38e4ba2e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec02579-a68d-4aef-8070-95de214fbe23', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fbbd76-ae1c-43cf-a57c-33f69481983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:15 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca 1073741824 Jul 30 16:32:15 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:15 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Volume volume-7ec02579-a68d-4aef-8070-95de214fbe23 (7ec02579-a68d-4aef-8070-95de214fbe23): created successfully Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fbbd76-ae1c-43cf-a57c-33f69481983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Flow 'volume_create_manager' (21297eec-7c5a-4835-bc58-c5b05acb9c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-aa51fefe-f494-43ef-a6fb-522a9631968c tempest-ServerActionsTestOtherA-1054032515 None] Created volume successfully. Jul 30 16:32:16 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca 1073741824" returned: 0 in 0.717s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:16 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca Jul 30 16:32:16 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Flow 'volume_create_manager' (e3ea64c0-2069-4b2b-b667-d80c2029b4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7887d11-524c-4e54-9e6f-099f61c70c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7887d11-524c-4e54-9e6f-099f61c70c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1997413415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922906f4-dcd2-4e47-9da0-1eeeb656937f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b246f98bfb9439cbd6ae859c1f04149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:17Z,use_quota=True,user_id='c0a8d1ae65af4924b592f515fe135576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3f2bd7-c580-44ed-bc9b-b5c83ff52374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3f2bd7-c580-44ed-bc9b-b5c83ff52374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1473d1-1039-4b2e-a361-f8497d4a75be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1473d1-1039-4b2e-a361-f8497d4a75be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '922906f4-dcd2-4e47-9da0-1eeeb656937f', 'volume_name': 'volume-922906f4-dcd2-4e47-9da0-1eeeb656937f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955e9949-8c4d-49c4-9c54-a08d53de73f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955e9949-8c4d-49c4-9c54-a08d53de73f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847717b4-9d55-4dc5-a5b9-602efe601dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:16 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Volume 922906f4-dcd2-4e47-9da0-1eeeb656937f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-922906f4-dcd2-4e47-9da0-1eeeb656937f', 'volume_size': 1} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:16 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca" returned: 0 in 0.324s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.210s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1997413415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922906f4-dcd2-4e47-9da0-1eeeb656937f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b246f98bfb9439cbd6ae859c1f04149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:17Z,use_quota=True,user_id='c0a8d1ae65af4924b592f515fe135576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Creating volume 922906f4-dcd2-4e47-9da0-1eeeb656937f {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:16 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de22574d-3635-40f2-8522-e2b2c1fc852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1548d7d2-7d69-4c44-b461-79632a79f1ca', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7381b46-ae95-42d2-a36f-c5c1ab0c6b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:16 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f 1073741824 Jul 30 16:32:16 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:16 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Volume volume-1548d7d2-7d69-4c44-b461-79632a79f1ca (1548d7d2-7d69-4c44-b461-79632a79f1ca): created successfully Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7381b46-ae95-42d2-a36f-c5c1ab0c6b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Flow 'volume_create_manager' (642fd03e-7fbc-4bb8-9110-b76ca9b40b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-df708cb9-8c8b-4bec-98c4-bef9894bd654 tempest-VolumesCloneTest-1237388161 None] Created volume successfully. Jul 30 16:32:17 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f 1073741824" returned: 0 in 0.516s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:17 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f Jul 30 16:32:17 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:17 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f" returned: 0 in 0.287s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847717b4-9d55-4dc5-a5b9-602efe601dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-922906f4-dcd2-4e47-9da0-1eeeb656937f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0648467e-d523-4014-a9bd-c9712ab52f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:17 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Volume volume-922906f4-dcd2-4e47-9da0-1eeeb656937f (922906f4-dcd2-4e47-9da0-1eeeb656937f): created successfully Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0648467e-d523-4014-a9bd-c9712ab52f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Flow 'volume_create_manager' (e3ea64c0-2069-4b2b-b667-d80c2029b4b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-14b1577b-46b7-4946-8ac1-43e79f972d2c tempest-AttachVolumeTestJSON-144241327 None] Created volume successfully. Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Flow 'volume_create_manager' (6c0bf8f5-1fcd-4cd1-8e6e-10791cb92b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e31fde1-f3fa-4bba-b8b0-d3680444bade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e31fde1-f3fa-4bba-b8b0-d3680444bade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1429050714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4af868a549d439e8eced35822b40167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1548d7d2-7d69-4c44-b461-79632a79f1ca,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:18Z,use_quota=True,user_id='514badf4a04e486790069ada8b4b18f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ec0cb6-87e8-466f-b762-a4b58334d173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ec0cb6-87e8-466f-b762-a4b58334d173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c69f7e-143e-4f4c-8c23-44671ebdba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c69f7e-143e-4f4c-8c23-44671ebdba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd', 'volume_name': 'volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd', 'volume_size': 2, 'source_volid': '1548d7d2-7d69-4c44-b461-79632a79f1ca', 'source_volstatus': 'available'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1510bc59-bb52-4f7b-be30-8da326cfce61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1510bc59-bb52-4f7b-be30-8da326cfce61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35be7cd-d613-4ba6-8619-b97b6308a2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:18 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Volume 2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd', 'volume_size': 2, 'source_volid': '1548d7d2-7d69-4c44-b461-79632a79f1ca', 'source_volstatus': 'available'} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:18 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Cloning volume 1548d7d2-7d69-4c44-b461-79632a79f1ca to volume 2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Creating offline snapshot 99ffd224-2a38-4036-b71f-942b66c724d8 of volume 1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98593c6-9eca-40c4-87f5-2f54eda079a7]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:18 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca Jul 30 16:32:18 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:19 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca" returned: 0 in 0.563s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:19 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 1G Jul 30 16:32:19 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:19 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 1G" returned: 0 in 0.779s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1548d7d2-7d69-4c44-b461-79632a79f1ca -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:19 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1548d7d2-7d69-4c44-b461-79632a79f1ca -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 Jul 30 16:32:19 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7930d629-3b1a-44b2-b76a-b61239c444f9 req-e81a2c8b-ef21-42b4-b011-2442c2262697 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:20 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1548d7d2-7d69-4c44-b461-79632a79f1ca -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8" returned: 0 in 0.409s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:20 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 is being set with open permissions: ugo+rw Jul 30 16:32:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:20 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 Jul 30 16:32:20 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:20 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8" returned: 0 in 0.437s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:20 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.info Jul 30 16:32:20 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:21 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.info" returned: 0 in 0.374s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:21 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.info is being set with open permissions: ugo+rw Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:21 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.info Jul 30 16:32:21 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:21 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.info" returned: 0 in 0.290s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "cinder-quobyte-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Lock "cinder-quobyte-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] snapshot: 99ffd224-2a38-4036-b71f-942b66c724d8, volume: 2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[957eda8a-c015-4fed-9ed5-5bfb7e112ea4]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:21 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 Jul 30 16:32:21 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Flow 'volume_create_manager' (8d117fa8-3833-4d03-9ac9-bc8c8b627bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be7ff18-b429-4c18-8b31-a9c55a96d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be7ff18-b429-4c18-8b31-a9c55a96d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1173111429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42084b7-14f3-401b-8043-17b674a10a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e5ed9f398c4b5d82c1515e8e58c180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:22Z,use_quota=True,user_id='8946a2ba5d514d1e8eb9786d776819e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ec047f-44b3-4829-8e1e-4db59e2d4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ec047f-44b3-4829-8e1e-4db59e2d4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539d54bb-e24c-4b7b-a71a-87b83ca943ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539d54bb-e24c-4b7b-a71a-87b83ca943ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42084b7-14f3-401b-8043-17b674a10a7a', 'volume_name': 'volume-e42084b7-14f3-401b-8043-17b674a10a7a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5139d1c3-264c-440c-85d6-b21f8cc7f1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5139d1c3-264c-440c-85d6-b21f8cc7f1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79e8310-b325-4fee-985c-572c5eccbb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:21 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Volume e42084b7-14f3-401b-8043-17b674a10a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42084b7-14f3-401b-8043-17b674a10a7a', 'volume_size': 1} Jul 30 16:32:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:22 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8" returned: 0 in 0.437s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1548d7d2-7d69-4c44-b461-79632a79f1ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029b25d-bce5-4f92-ae42-18c205924642]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:22 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca Jul 30 16:32:22 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:22 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca" returned: 0 in 0.425s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:32:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:22 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd Jul 30 16:32:22 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" returned: 0 in 6.000s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:32:28 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Converted 1024.00 MB image at 170.62 MB/s Jul 30 16:32:28 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd is being set with open permissions: ugo+rw Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:28 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd Jul 30 16:32:28 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:28 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" returned: 0 in 0.292s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Lock "cinder-quobyte-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" released by "_copy_volume_from_snapshot" :: held 7.251s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "cinder-quobyte-99ffd224-2a38-4036-b71f-942b66c724d8" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Lock "cinder-quobyte-99ffd224-2a38-4036-b71f-942b66c724d8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Deleting offline snapshot 99ffd224-2a38-4036-b71f-942b66c724d8 of volume 1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] snapshot_file for this snap is: volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25f0ac0-bd07-4b2e-a4a4-d5120e91af80]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:28 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 Jul 30 16:32:28 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:29 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8" returned: 0 in 0.382s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1548d7d2-7d69-4c44-b461-79632a79f1ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:32:29 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad600a1-e258-470c-955d-8f50736c15ff]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:29 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca Jul 30 16:32:29 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:29 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca" returned: 0 in 0.500s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:29 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 Jul 30 16:32:29 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:30 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8" returned: 0 in 0.346s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:30 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8 Jul 30 16:32:30 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:30 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca.99ffd224-2a38-4036-b71f-942b66c724d8" returned: 0 in 0.292s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Lock "cinder-quobyte-99ffd224-2a38-4036-b71f-942b66c724d8" released by "_delete_snapshot" :: held 1.650s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.031s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7930d629-3b1a-44b2-b76a-b61239c444f9 req-e81a2c8b-ef21-42b4-b011-2442c2262697 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.574s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7930d629-3b1a-44b2-b76a-b61239c444f9 req-e81a2c8b-ef21-42b4-b011-2442c2262697 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.712s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1173111429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42084b7-14f3-401b-8043-17b674a10a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e5ed9f398c4b5d82c1515e8e58c180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:22Z,use_quota=True,user_id='8946a2ba5d514d1e8eb9786d776819e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Creating volume e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:30 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35be7cd-d613-4ba6-8619-b97b6308a2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd', 'volume_size': 2, 'source_volid': '1548d7d2-7d69-4c44-b461-79632a79f1ca', 'source_volstatus': 'available'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c017f81a-a9d5-4b29-ba73-d0cdf3d013e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:30 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a 1073741824 Jul 30 16:32:30 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Volume volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd (2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd): created successfully Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c017f81a-a9d5-4b29-ba73-d0cdf3d013e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Flow 'volume_create_manager' (6c0bf8f5-1fcd-4cd1-8e6e-10791cb92b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-7930d629-3b1a-44b2-b76a-b61239c444f9 req-e81a2c8b-ef21-42b4-b011-2442c2262697 tempest-AttachVolumeTestJSON-144241327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-922906f4-dcd2-4e47-9da0-1eeeb656937f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ea799f3-d270-497a-972d-a99a6fa2cb4e', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:32:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7bf519da-756e-4c97-a807-0d8c10093e54 tempest-VolumesCloneTest-1237388161 None] Created volume successfully. Jul 30 16:32:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-7930d629-3b1a-44b2-b76a-b61239c444f9 req-e81a2c8b-ef21-42b4-b011-2442c2262697 tempest-AttachVolumeTestJSON-144241327 None] attachment_update completed successfully. Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "cinder-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Lock "cinder-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "cinder-quobyte-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Lock "cinder-quobyte-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c28e6bb-05f3-40cb-9571-03c77ec8f1d0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:31 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd Jul 30 16:32:31 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:31 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a 1073741824" returned: 0 in 0.876s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:31 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a Jul 30 16:32:31 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:31 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a" returned: 0 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79e8310-b325-4fee-985c-572c5eccbb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42084b7-14f3-401b-8043-17b674a10a7a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe7f196-3a5b-4caa-9384-54ee4cd275bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:31 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" returned: 0 in 0.686s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Volume volume-e42084b7-14f3-401b-8043-17b674a10a7a (e42084b7-14f3-401b-8043-17b674a10a7a): created successfully Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe7f196-3a5b-4caa-9384-54ee4cd275bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:31 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd Jul 30 16:32:31 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Flow 'volume_create_manager' (8d117fa8-3833-4d03-9ac9-bc8c8b627bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-020d2e5d-1f42-4197-a879-35f64a7e17a2 tempest-VolumesDeleteCascade-1656848810 None] Created volume successfully. Jul 30 16:32:32 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" returned: 0 in 0.302s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Lock "cinder-quobyte-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd" released by "delete_volume" :: held 1.055s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Created reservations ['13ab44fa-6deb-49a6-a027-53e52eb9dc1a', '29797d43-9268-4e57-91c5-afd37f727573', '974b9f9b-55a6-4061-81ba-dc27ecd0b95d', '21f60322-63bc-4f6d-9bf1-a44c932c1c63'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:32 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:32 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:32 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Deleted volume successfully. Jul 30 16:32:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-95af53e5-2b56-4bf9-97a9-ebd49ca8c667 tempest-VolumesCloneTest-1237388161 None] Lock "cinder-2f1f73e2-2d0b-4a25-a4d0-d52e00ee47fd-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Creating offline snapshot bb823d68-6479-41be-9127-47467e94beea of volume e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5146dad9-39bc-4625-ba85-3394f0318cae]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:33 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a Jul 30 16:32:33 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Acquiring lock "cinder-1548d7d2-7d69-4c44-b461-79632a79f1ca-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Lock "cinder-1548d7d2-7d69-4c44-b461-79632a79f1ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=92,cinder:UPDATE=101,cinder:INSERT=24,cinder:DELETE=12 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Acquiring lock "cinder-quobyte-1548d7d2-7d69-4c44-b461-79632a79f1ca" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Lock "cinder-quobyte-1548d7d2-7d69-4c44-b461-79632a79f1ca" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[81df64f3-58af-4dce-9d8d-8b1fc857f78e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-3abc5c8f-a1b6-4554-afe8-597b3d162d9e req-41668a43-9b62-4e4a-ab18-a3c1e4789509 tempest-AttachVolumeTestJSON-144241327 None] Terminate volume connection completed successfully. Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-3abc5c8f-a1b6-4554-afe8-597b3d162d9e req-41668a43-9b62-4e4a-ab18-a3c1e4789509 tempest-AttachVolumeTestJSON-144241327 None] Deleting attachment 4685a969-be5e-43ae-b5b2-3682881349b7. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:32:33 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca Jul 30 16:32:33 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:33 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a" returned: 0 in 0.522s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:33 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea 1G Jul 30 16:32:33 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:34 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca" returned: 0 in 0.525s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:34 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca Jul 30 16:32:34 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:34 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea 1G" returned: 0 in 0.502s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42084b7-14f3-401b-8043-17b674a10a7a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:34 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42084b7-14f3-401b-8043-17b674a10a7a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea Jul 30 16:32:34 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:34 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1548d7d2-7d69-4c44-b461-79632a79f1ca" returned: 0 in 0.356s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Lock "cinder-quobyte-1548d7d2-7d69-4c44-b461-79632a79f1ca" released by "delete_volume" :: held 0.973s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=103,cinder:SELECT=81,cinder:INSERT=18,cinder:DELETE=7 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Created reservations ['a67e395d-2628-4819-9bc8-e5892bc6bd26', 'a88763bb-aebf-4abf-90d4-62307ab614f2', 'de488726-d6d3-427f-a852-b583d92d68a3', 'bd234410-48cd-4e63-8465-6113830c116c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:34 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42084b7-14f3-401b-8043-17b674a10a7a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea" returned: 0 in 0.397s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:34 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea is being set with open permissions: ugo+rw Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:34 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea Jul 30 16:32:34 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:34 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:34 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:35 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea" returned: 0 in 0.295s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:35 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.info Jul 30 16:32:35 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:35 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.315s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Deleted volume successfully. Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3369da43-ce5b-40c3-8505-71b315306cbd tempest-VolumesCloneTest-1237388161 None] Lock "cinder-1548d7d2-7d69-4c44-b461-79632a79f1ca-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-2a8f0a69-fe2a-4478-8469-680b2aaa66ac req-005b2bf0-dad5-4882-aa23-213e375aa408 tempest-AttachVolumeTestJSON-144241327 None] Terminate volume connection completed successfully. Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-2a8f0a69-fe2a-4478-8469-680b2aaa66ac req-005b2bf0-dad5-4882-aa23-213e375aa408 tempest-AttachVolumeTestJSON-144241327 None] Deleting attachment 9ea799f3-d270-497a-972d-a99a6fa2cb4e. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:32:35 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.info" returned: 0 in 0.319s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:35 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.info is being set with open permissions: ugo+rw Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:35 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.info Jul 30 16:32:35 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:35 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.info" returned: 0 in 0.266s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a23c798f-bfa0-4f8d-a700-f4f33fd497b6 tempest-VolumesDeleteCascade-1656848810 None] Create snapshot completed successfully Jul 30 16:32:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Creating offline snapshot 24d8f5f2-4db9-40a5-af34-d3f37d363036 of volume e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:32:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f9d900-26ef-4ed5-9431-4b8c98801e9a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:37 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea Jul 30 16:32:37 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:37 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea" returned: 0 in 0.668s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e42084b7-14f3-401b-8043-17b674a10a7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:32:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:37 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 1G Jul 30 16:32:37 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:38 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 1G" returned: 0 in 0.939s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:38 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 Jul 30 16:32:38 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:39 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036" returned: 0 in 0.460s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:39 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 is being set with open permissions: ugo+rw Jul 30 16:32:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:39 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 Jul 30 16:32:39 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:39 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036" returned: 0 in 0.281s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1f7d0b6d-409e-4ec3-85fd-8a15535475c0 tempest-VolumesDeleteCascade-1656848810 None] Create snapshot completed successfully Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-e42084b7-14f3-401b-8043-17b674a10a7a-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-e42084b7-14f3-401b-8043-17b674a10a7a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Performing cascade delete. {{(pid=88095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-24d8f5f2-4db9-40a5-af34-d3f37d363036-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-24d8f5f2-4db9-40a5-af34-d3f37d363036-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-24d8f5f2-4db9-40a5-af34-d3f37d363036" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-24d8f5f2-4db9-40a5-af34-d3f37d363036" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Deleting offline snapshot 24d8f5f2-4db9-40a5-af34-d3f37d363036 of volume e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] snapshot_file for this snap is: volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa18b94b-4470-4262-81a9-e06c0a9ead7d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:40 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 Jul 30 16:32:40 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:40 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036" returned: 0 in 0.440s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e42084b7-14f3-401b-8043-17b674a10a7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[267fbc0d-4d6a-4b6a-b600-a19b467d4194]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:40 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea Jul 30 16:32:40 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Flow 'volume_create_manager' (2b21fa80-0ffa-46a5-94d1-6afc28d36962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4d1c92-5c39-4555-b5db-568db3ecab39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4d1c92-5c39-4555-b5db-568db3ecab39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1236882852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a05fe0f-974b-4e22-837a-15e0c3c5a525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33672928b0864807915bd2e28e4eaf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:41Z,use_quota=True,user_id='d47abbaf34c446c999d3201686a4e3ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24569a5-fb31-4786-bdab-6ec422bee65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24569a5-fb31-4786-bdab-6ec422bee65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9232b445-57d6-4dcb-af67-96dca1d07c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:32:41 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "cinder-922906f4-dcd2-4e47-9da0-1eeeb656937f-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea" returned: 0 in 0.520s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e42084b7-14f3-401b-8043-17b674a10a7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-922906f4-dcd2-4e47-9da0-1eeeb656937f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:41 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 Jul 30 16:32:41 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "cinder-quobyte-922906f4-dcd2-4e47-9da0-1eeeb656937f" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-quobyte-922906f4-dcd2-4e47-9da0-1eeeb656937f" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f4c591-1323-47c6-af12-3bc18d24518b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:41 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f Jul 30 16:32:41 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9232b445-57d6-4dcb-af67-96dca1d07c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a05fe0f-974b-4e22-837a-15e0c3c5a525', 'volume_name': 'volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c43f18e-cbbb-496f-8fef-24981342d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:41 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c43f18e-cbbb-496f-8fef-24981342d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6faab163-6c32-46cd-b627-e96375375ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Volume 1a05fe0f-974b-4e22-837a-15e0c3c5a525: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Trying to clone 1a05fe0f-974b-4e22-837a-15e0c3c5a525 from image ea19a761-954a-4f28-b989-b2705e0735e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036" returned: 0 in 0.512s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:41 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f" returned: 0 in 0.412s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:41 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036 Jul 30 16:32:41 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:41 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f Jul 30 16:32:41 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:42 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.24d8f5f2-4db9-40a5-af34-d3f37d363036" returned: 0 in 0.339s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-24d8f5f2-4db9-40a5-af34-d3f37d363036" released by "_delete_snapshot" :: held 1.968s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" released by "delete_snapshot" :: held 1.997s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:42 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-922906f4-dcd2-4e47-9da0-1eeeb656937f" returned: 0 in 0.418s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:32:42 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-quobyte-922906f4-dcd2-4e47-9da0-1eeeb656937f" released by "delete_volume" :: held 0.901s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Created reservations ['a8278e34-cb53-482e-b2b7-dc804814e27c', '6820b7dd-c367-4731-98be-2ada9825c677', '5c4b1ce9-e147-4cb8-b752-8053f88684af', '83511947-b5b8-45fd-b75c-a3903ca7bb07'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d9743a-39c8-4ec9-93d3-e3596ae0ebda]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Created reservations ['e34a934f-a2d0-41f8-b4ea-407b663ddf9d', 'd4ea9606-3c0c-483b-8763-bf74321bcc36', 'd67a676a-555f-43d6-940f-9b9847130f1e', '109572ed-5140-40ba-8c7c-191ca72aa92e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:42 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Delete snapshot completed successfully. Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-24d8f5f2-4db9-40a5-af34-d3f37d363036-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-bb823d68-6479-41be-9127-47467e94beea-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-bb823d68-6479-41be-9127-47467e94beea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:42 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD Jul 30 16:32:42 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-bb823d68-6479-41be-9127-47467e94beea" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:42 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:42 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-bb823d68-6479-41be-9127-47467e94beea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Deleting offline snapshot bb823d68-6479-41be-9127-47467e94beea of volume e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] snapshot_file for this snap is: volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3b3dcf-c8fc-426e-ad0a-70b43f68a953]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:42 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea Jul 30 16:32:42 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:42 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Temporary image ea19a761-954a-4f28-b989-b2705e0735e6 is fetched for user d47abbaf34c446c999d3201686a4e3ce. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:32:42 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.283s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:42 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Deleted volume successfully. Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-20b4ca55-eeb7-495a-9037-14dd011cfb30 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-922906f4-dcd2-4e47-9da0-1eeeb656937f-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c85706d-889e-4b08-b907-fdd6673fcf51]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:42 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD Jul 30 16:32:42 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:43 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea" returned: 0 in 0.418s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e42084b7-14f3-401b-8043-17b674a10a7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2b6a21-c2c6-4646-8b84-866baf7071ba]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:43 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a Jul 30 16:32:43 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:43 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1236882852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a05fe0f-974b-4e22-837a-15e0c3c5a525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33672928b0864807915bd2e28e4eaf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:41Z,use_quota=True,user_id='d47abbaf34c446c999d3201686a4e3ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Creating volume 1a05fe0f-974b-4e22-837a-15e0c3c5a525 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:43 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:43 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 1073741824 Jul 30 16:32:43 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:43 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a" returned: 0 in 0.392s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:43 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea Jul 30 16:32:43 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "cinder-fd3c9e64-668f-4e9d-8421-135a94f6a3e2-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-fd3c9e64-668f-4e9d-8421-135a94f6a3e2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "cinder-quobyte-fd3c9e64-668f-4e9d-8421-135a94f6a3e2" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-quobyte-fd3c9e64-668f-4e9d-8421-135a94f6a3e2" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a9dac9-2881-4f9a-a425-548ae3a77641]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:43 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 1073741824" returned: 0 in 0.561s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:43 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 Jul 30 16:32:43 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:43 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:43 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 Jul 30 16:32:43 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:43 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea Jul 30 16:32:43 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:44 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2" returned: 0 in 0.399s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:44 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525" returned: 0 in 0.300s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:44 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2 Jul 30 16:32:44 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:44 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a.bb823d68-6479-41be-9127-47467e94beea" returned: 0 in 0.306s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-bb823d68-6479-41be-9127-47467e94beea" released by "_delete_snapshot" :: held 1.630s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Attempting download of ea19a761-954a-4f28-b989-b2705e0735e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}])) to volume 1a05fe0f-974b-4e22-837a-15e0c3c5a525. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" released by "delete_snapshot" :: held 1.659s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2715d2-cce5-4509-b6de-8058b8d36c36]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_mkjmo3tb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Created reservations ['afe1e559-522d-4056-a6b7-7ede6d88ea8b', '1a043bbc-49b3-460b-a8b5-536dd4bcc628', 'bfd5f7f0-ffbd-4ad9-900a-20b9cc5fd504', 'fc9ded43-594f-4d66-97be-086168c02e84'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:44 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Delete snapshot completed successfully. Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-bb823d68-6479-41be-9127-47467e94beea-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Snapshots deleted, issuing volume delete {{(pid=88095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:44 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_mkjmo3tb Jul 30 16:32:44 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:44 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fd3c9e64-668f-4e9d-8421-135a94f6a3e2" returned: 0 in 0.315s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf3dbb-52bb-4eca-a45d-7e2f7f33317d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-quobyte-fd3c9e64-668f-4e9d-8421-135a94f6a3e2" released by "delete_volume" :: held 0.779s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Created reservations ['6d3cacab-6db9-420f-811a-582875f8e98b', 'af7934ce-3453-4fad-97ba-38e95ba65059', '8c5a6aec-2703-4cbe-9b39-101c18467f56', '138d0d30-6a07-4338-9839-294a4b99d371'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:44 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a Jul 30 16:32:44 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:44 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_mkjmo3tb" returned: 0 in 0.389s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_mkjmo3tb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:44 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:44 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:44 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_mkjmo3tb Jul 30 16:32:44 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:44 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a" returned: 0 in 0.420s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:44 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a Jul 30 16:32:44 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "cinder-b2781b07-cbcb-4783-962f-5d40e09ebb14-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-b2781b07-cbcb-4783-962f-5d40e09ebb14-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:44 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.321s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:44 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Deleted volume successfully. Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "cinder-quobyte-b2781b07-cbcb-4783-962f-5d40e09ebb14" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-183c0d05-3fe4-4fd3-a97e-f4195db72c31 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-fd3c9e64-668f-4e9d-8421-135a94f6a3e2-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-quobyte-b2781b07-cbcb-4783-962f-5d40e09ebb14" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[211076eb-6c66-4a91-8557-c8308537c762]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:45 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_mkjmo3tb" returned: 1 in 0.453s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_mkjmo3tb' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e41a0-8903-462f-a1a8-62631d16cb5b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:45 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e42084b7-14f3-401b-8043-17b674a10a7a" returned: 0 in 0.308s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:45 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 Jul 30 16:32:45 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-e42084b7-14f3-401b-8043-17b674a10a7a" released by "delete_volume" :: held 0.814s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:45 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD Jul 30 16:32:45 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Created reservations ['17ef9721-8845-4246-a2a2-4fa96bf2a06a', '0cc467bb-9f80-4fb5-a72c-456463b374ad', '7c072edb-9816-482e-93d2-aa531747a851', '96973cc8-bbb3-442c-82eb-68477e580dec'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:45 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:45 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:45 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14" returned: 0 in 0.399s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:45 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] ea19a761-954a-4f28-b989-b2705e0735e6 was qcow2, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:45 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14 Jul 30 16:32:45 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:45 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 Jul 30 16:32:45 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:45 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.281s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Deleted volume successfully. Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cc98cc08-5cb1-4cfb-94c8-e2a230b61e4a tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-e42084b7-14f3-401b-8043-17b674a10a7a-delete_volume" released by "delete_volume" :: held 5.535s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:45 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b2781b07-cbcb-4783-962f-5d40e09ebb14" returned: 0 in 0.286s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-quobyte-b2781b07-cbcb-4783-962f-5d40e09ebb14" released by "delete_volume" :: held 0.752s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Created reservations ['9e9a703e-0cfd-467d-9d6e-412a1d348b17', 'b082a8d0-4fcc-4f98-a256-08204bdbdfee', '3df3a11b-53a7-4f57-925c-9932083480b3', '9809283b-8c32-4859-a1c7-49ae2f883ef5'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:45 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:45 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:46 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.289s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Deleted volume successfully. Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1e0df533-90a9-4677-b6fc-2538814ffa90 tempest-AttachVolumeTestJSON-144241327 None] Lock "cinder-b2781b07-cbcb-4783-962f-5d40e09ebb14-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Flow 'volume_create_manager' (fb34c34a-7032-487e-8b1d-5ec17c62a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42251efe-134c-46c2-850b-6c8e3e583d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42251efe-134c-46c2-850b-6c8e3e583d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-999907309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69225a5-60e1-4cd8-b7a1-0c1887414a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e5ed9f398c4b5d82c1515e8e58c180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:46Z,use_quota=True,user_id='8946a2ba5d514d1e8eb9786d776819e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f649fc-e739-4950-8e98-bbcc117dbb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f649fc-e739-4950-8e98-bbcc117dbb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e834e0b-d4f1-4dc9-9e29-694d9662eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e834e0b-d4f1-4dc9-9e29-694d9662eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69225a5-60e1-4cd8-b7a1-0c1887414a38', 'volume_name': 'volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6991ab-52dc-460b-8b2a-5eea531aae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6991ab-52dc-460b-8b2a-5eea531aae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20865bae-0131-41c9-b179-d855cce3fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:46 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Volume d69225a5-60e1-4cd8-b7a1-0c1887414a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38', 'volume_size': 1} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-999907309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69225a5-60e1-4cd8-b7a1-0c1887414a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e5ed9f398c4b5d82c1515e8e58c180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:46Z,use_quota=True,user_id='8946a2ba5d514d1e8eb9786d776819e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Creating volume d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:46 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:46 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 1073741824 Jul 30 16:32:46 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:47 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 1073741824" returned: 0 in 0.630s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:47 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 Jul 30 16:32:47 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:47 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:47 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:47 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38" returned: 0 in 0.420s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20865bae-0131-41c9-b179-d855cce3fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3f864d-4303-47f2-b3b2-de77b7f3b161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:47 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Volume volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 (d69225a5-60e1-4cd8-b7a1-0c1887414a38): created successfully Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3f864d-4303-47f2-b3b2-de77b7f3b161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:47 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Flow 'volume_create_manager' (fb34c34a-7032-487e-8b1d-5ec17c62a67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:32:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7b5c3a79-d6cf-456b-af99-c7c3251188fd tempest-VolumesDeleteCascade-1656848810 None] Created volume successfully. Jul 30 16:32:47 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525" returned: 0 in 2.531s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_mdlw3tasdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:32:47 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Converted 112.00 MB image at 44.23 MB/s Jul 30 16:32:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:48 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 1G Jul 30 16:32:48 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:48 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 1G" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Downloaded image ea19a761-954a-4f28-b989-b2705e0735e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}])) to volume 1a05fe0f-974b-4e22-837a-15e0c3c5a525 successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Temporary image ea19a761-954a-4f28-b989-b2705e0735e6 for user d47abbaf34c446c999d3201686a4e3ce is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Marking volume 1a05fe0f-974b-4e22-837a-15e0c3c5a525 as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Copying metadata from image ea19a761-954a-4f28-b989-b2705e0735e6 to 1a05fe0f-974b-4e22-837a-15e0c3c5a525. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Creating volume glance metadata for volume 1a05fe0f-974b-4e22-837a-15e0c3c5a525 backed by image ea19a761-954a-4f28-b989-b2705e0735e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6faab163-6c32-46cd-b627-e96375375ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea596e68-cec2-4248-8d48-c3d6e20f769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:48 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Volume volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 (1a05fe0f-974b-4e22-837a-15e0c3c5a525): created successfully Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea596e68-cec2-4248-8d48-c3d6e20f769b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Flow 'volume_create_manager' (2b21fa80-0ffa-46a5-94d1-6afc28d36962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ca7c2658-0580-495b-a010-9a9f0eee9d94 tempest-VolumesExtendTest-140455990 None] Created volume successfully. Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Creating offline snapshot ef7cb997-cee2-44e3-a0b0-9e8673704824 of volume d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97efbca6-df93-4d03-b004-d847189058d4]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:48 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 Jul 30 16:32:48 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:49 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38" returned: 0 in 0.392s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:49 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 1G Jul 30 16:32:49 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:49 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 1G" returned: 0 in 0.445s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:49 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 Jul 30 16:32:49 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2812aecf-5c24-4ba9-94b3-a01dc59cd860 tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:50 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824" returned: 0 in 0.444s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:50 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 is being set with open permissions: ugo+rw Jul 30 16:32:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:50 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 Jul 30 16:32:50 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:50 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824" returned: 0 in 0.274s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:50 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.info Jul 30 16:32:50 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:50 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.info" returned: 0 in 0.337s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:50 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.info is being set with open permissions: ugo+rw Jul 30 16:32:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:50 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.info Jul 30 16:32:50 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:51 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.info" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2812aecf-5c24-4ba9-94b3-a01dc59cd860 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0a848d-dc98-4f6b-a587-b6196ab6e26c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2812aecf-5c24-4ba9-94b3-a01dc59cd860 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-059b28c4-2132-4088-8c37-2f601c79c86d tempest-VolumesDeleteCascade-1656848810 None] Create snapshot completed successfully Jul 30 16:32:51 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 Jul 30 16:32:51 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:51 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2812aecf-5c24-4ba9-94b3-a01dc59cd860 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525" returned: 0 in 0.410s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2812aecf-5c24-4ba9-94b3-a01dc59cd860 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 2G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2812aecf-5c24-4ba9-94b3-a01dc59cd860 tempest-VolumesExtendTest-140455990 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 2G" returned: 0 in 0.127s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2812aecf-5c24-4ba9-94b3-a01dc59cd860 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.571s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2812aecf-5c24-4ba9-94b3-a01dc59cd860 tempest-VolumesExtendTest-140455990 None] Extend volume completed successfully. Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Acquiring lock "cinder-1a05fe0f-974b-4e22-837a-15e0c3c5a525-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Lock "cinder-1a05fe0f-974b-4e22-837a-15e0c3c5a525-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Flow 'volume_create_manager' (3942de4d-26e2-4c8a-abfd-29e94a13c182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbe9904-aad8-4489-9ca6-977085c5d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbe9904-aad8-4489-9ca6-977085c5d411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1018045580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e5ed9f398c4b5d82c1515e8e58c180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef7cb997-cee2-44e3-a0b0-9e8673704824,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:53Z,use_quota=True,user_id='8946a2ba5d514d1e8eb9786d776819e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fb8f0e-5b8f-4290-9712-c2c8ef4f8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fb8f0e-5b8f-4290-9712-c2c8ef4f8b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3a83bc-f6d3-4dc9-864b-f7becbb952c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3a83bc-f6d3-4dc9-864b-f7becbb952c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b', 'volume_name': 'volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b', 'volume_size': 1, 'snapshot_id': 'ef7cb997-cee2-44e3-a0b0-9e8673704824'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad75284-fe48-4296-b247-3054dff092cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad75284-fe48-4296-b247-3054dff092cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a314904f-e99a-41ef-813e-1b42e9492caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:52 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Volume a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b', 'volume_size': 1, 'snapshot_id': 'ef7cb997-cee2-44e3-a0b0-9e8673704824'} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Acquiring lock "cinder-quobyte-1a05fe0f-974b-4e22-837a-15e0c3c5a525" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-ef7cb997-cee2-44e3-a0b0-9e8673704824-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Lock "cinder-quobyte-1a05fe0f-974b-4e22-837a-15e0c3c5a525" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-ef7cb997-cee2-44e3-a0b0-9e8673704824-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Creating volume a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b from snapshot ef7cb997-cee2-44e3-a0b0-9e8673704824 {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0881dafe-db58-40d1-8873-0659eb7edbef]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:32:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] snapshot: ef7cb997-cee2-44e3-a0b0-9e8673704824, volume: a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa416b6b-6f37-4f78-8920-ef8116a1467e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:53 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 Jul 30 16:32:53 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:53 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 Jul 30 16:32:53 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:53 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525" returned: 0 in 0.503s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:53 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525 Jul 30 16:32:53 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:53 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824" returned: 0 in 0.484s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03dbe9b-3091-4fff-a561-aeeeee34d795]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:53 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 Jul 30 16:32:53 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:53 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1a05fe0f-974b-4e22-837a-15e0c3c5a525" returned: 0 in 0.308s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Lock "cinder-quobyte-1a05fe0f-974b-4e22-837a-15e0c3c5a525" released by "delete_volume" :: held 0.880s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Created reservations ['fb1d9efe-e504-4447-92f5-0f38640a378e', 'a492f326-b74d-4b8f-b41d-4d260313e2db', '47ef48d5-aafd-4046-b1f0-a736ed36da1b', '7f49e4fd-0a1b-4693-85f7-0d4bda9a6443'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e8386ac6-df0c-4b59-a537-1255cb0fb907 req-6ba8830a-a254-4840-afbe-08ae2ec02c33 tempest-ServerActionsTestOtherA-1054032515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:54 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:32:54 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:54 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38" returned: 0 in 0.508s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:32:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:32:54 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:32:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:54 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b Jul 30 16:32:54 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:54 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.337s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:54 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Deleted volume successfully. Jul 30 16:32:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9106f6aa-41ea-46f8-9dbf-0c616767021a tempest-VolumesExtendTest-140455990 None] Lock "cinder-1a05fe0f-974b-4e22-837a-15e0c3c5a525-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Flow 'volume_create_manager' (6ff9e3d5-983d-4011-bbb4-ce9c52c4b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f16f14-31c2-4af2-8be3-faf0fb845dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f16f14-31c2-4af2-8be3-faf0fb845dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1923724217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99202525-bcb8-45b3-bee4-aff03b0b94b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33672928b0864807915bd2e28e4eaf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:56Z,use_quota=True,user_id='d47abbaf34c446c999d3201686a4e3ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a16d421-0a2d-4937-b71d-0a66b7769d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a16d421-0a2d-4937-b71d-0a66b7769d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6102b3-5132-41d2-8636-4e6a67da4e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6102b3-5132-41d2-8636-4e6a67da4e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99202525-bcb8-45b3-bee4-aff03b0b94b8', 'volume_name': 'volume-99202525-bcb8-45b3-bee4-aff03b0b94b8', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46263ca-675d-4568-9351-9ad48207c182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46263ca-675d-4568-9351-9ad48207c182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ed1663-5e76-4e55-8acb-2ac94203e5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:56 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Volume 99202525-bcb8-45b3-bee4-aff03b0b94b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99202525-bcb8-45b3-bee4-aff03b0b94b8', 'volume_size': 1} Jul 30 16:32:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:59 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" returned: 0 in 5.286s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:32:59 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Converted 1024.00 MB image at 193.70 MB/s Jul 30 16:32:59 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b is being set with open permissions: ugo+rw Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:59 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b Jul 30 16:32:59 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:59 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" returned: 0 in 0.244s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" released by "_copy_volume_from_snapshot" :: held 6.677s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-ef7cb997-cee2-44e3-a0b0-9e8673704824-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" released by "_create_volume_from_snapshot" :: held 6.771s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.815s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e8386ac6-df0c-4b59-a537-1255cb0fb907 req-6ba8830a-a254-4840-afbe-08ae2ec02c33 tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.794s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-e8386ac6-df0c-4b59-a537-1255cb0fb907 req-6ba8830a-a254-4840-afbe-08ae2ec02c33 tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.226s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1923724217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99202525-bcb8-45b3-bee4-aff03b0b94b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33672928b0864807915bd2e28e4eaf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:32:56Z,use_quota=True,user_id='d47abbaf34c446c999d3201686a4e3ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Creating volume 99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:32:59 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:59 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 1073741824 Jul 30 16:32:59 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a314904f-e99a-41ef-813e-1b42e9492caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b', 'volume_size': 1, 'snapshot_id': 'ef7cb997-cee2-44e3-a0b0-9e8673704824'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f935220c-6690-4f65-abc2-f8b348ae99a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:32:59 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Volume volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b (a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b): created successfully Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f935220c-6690-4f65-abc2-f8b348ae99a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Flow 'volume_create_manager' (3942de4d-26e2-4c8a-abfd-29e94a13c182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:32:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e8386ac6-df0c-4b59-a537-1255cb0fb907 req-6ba8830a-a254-4840-afbe-08ae2ec02c33 tempest-ServerActionsTestOtherA-1054032515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-7ec02579-a68d-4aef-8070-95de214fbe23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07500b64-5b2e-455f-90f2-8f18530f078c', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:32:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c0336285-7bb4-415e-87dc-bb46dd7dd9d9 tempest-VolumesDeleteCascade-1656848810 None] Created volume successfully. Jul 30 16:32:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-e8386ac6-df0c-4b59-a537-1255cb0fb907 req-6ba8830a-a254-4840-afbe-08ae2ec02c33 tempest-ServerActionsTestOtherA-1054032515 None] attachment_update completed successfully. Jul 30 16:33:00 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 1073741824" returned: 0 in 0.572s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:00 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 Jul 30 16:33:00 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:00 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8" returned: 0 in 0.330s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ed1663-5e76-4e55-8acb-2ac94203e5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99202525-bcb8-45b3-bee4-aff03b0b94b8', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613f76ca-1cb2-4484-a4dc-af9c5513fc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-d69225a5-60e1-4cd8-b7a1-0c1887414a38-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:00 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Volume volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 (99202525-bcb8-45b3-bee4-aff03b0b94b8): created successfully Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613f76ca-1cb2-4484-a4dc-af9c5513fc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Flow 'volume_create_manager' (6ff9e3d5-983d-4011-bbb4-ce9c52c4b437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-d69225a5-60e1-4cd8-b7a1-0c1887414a38-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6eb20323-0fb7-48e0-a72e-815625edb250 tempest-VolumesExtendTest-140455990 None] Created volume successfully. Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Performing cascade delete. {{(pid=88095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-ef7cb997-cee2-44e3-a0b0-9e8673704824-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-ef7cb997-cee2-44e3-a0b0-9e8673704824-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-d69225a5-60e1-4cd8-b7a1-0c1887414a38" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-d69225a5-60e1-4cd8-b7a1-0c1887414a38" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-ef7cb997-cee2-44e3-a0b0-9e8673704824" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-ef7cb997-cee2-44e3-a0b0-9e8673704824" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Deleting offline snapshot ef7cb997-cee2-44e3-a0b0-9e8673704824 of volume d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] snapshot_file for this snap is: volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63f32a-1afa-47e5-b242-3ff84e308db1]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:01 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 Jul 30 16:33:01 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:01 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824" returned: 0 in 0.440s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce16d8-99fa-4d29-bfc7-4afb5e8865ae]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:01 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 Jul 30 16:33:01 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Creating offline snapshot 0ca2623a-e3c3-48b4-903d-2f85997acec6 of volume 99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:33:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9612514-19f7-4a4e-80b1-2f01273906ea]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:02 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 Jul 30 16:33:02 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:02 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38" returned: 0 in 0.794s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:02 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 Jul 30 16:33:02 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:02 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8" returned: 0 in 0.535s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:02 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 1G Jul 30 16:33:02 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:02 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824" returned: 0 in 0.431s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:02 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824 Jul 30 16:33:02 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:03 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38.ef7cb997-cee2-44e3-a0b0-9e8673704824" returned: 0 in 0.372s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-ef7cb997-cee2-44e3-a0b0-9e8673704824" released by "_delete_snapshot" :: held 2.178s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-d69225a5-60e1-4cd8-b7a1-0c1887414a38" released by "delete_snapshot" :: held 2.218s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Created reservations ['703cf32e-f5d7-4205-b1b1-1435d5fa3be8', '01d4ea72-abf3-4525-bcfc-1da3a8b7a770', '9aef88f9-cd4d-4dd9-b720-c12ed2467296', 'df107779-8b91-4cec-9612-1496d00be102'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:03 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 1G" returned: 0 in 0.759s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:03 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 Jul 30 16:33:03 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:03 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Delete snapshot completed successfully. Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-ef7cb997-cee2-44e3-a0b0-9e8673704824-delete_snapshot" released by "delete_snapshot" :: held 2.501s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Snapshots deleted, issuing volume delete {{(pid=88095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-d69225a5-60e1-4cd8-b7a1-0c1887414a38" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-d69225a5-60e1-4cd8-b7a1-0c1887414a38" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad8356a-60dd-432d-879f-24eb5e387435]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:03 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 Jul 30 16:33:03 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:03 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6" returned: 0 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:03 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 is being set with open permissions: ugo+rw Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:03 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 Jul 30 16:33:03 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:03 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38" returned: 0 in 0.486s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:04 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38 Jul 30 16:33:04 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:04 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6" returned: 0 in 0.382s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:04 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.info Jul 30 16:33:04 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:04 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d69225a5-60e1-4cd8-b7a1-0c1887414a38" returned: 0 in 0.400s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-d69225a5-60e1-4cd8-b7a1-0c1887414a38" released by "delete_volume" :: held 0.978s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Created reservations ['536be80f-7607-4348-8825-c42d590b34e3', '1b35e6de-a001-4965-94d7-7d73686232f7', '34e92f77-9ee6-47c7-9c41-18ab08398732', '964227c3-fac7-470b-a9cf-480f81d0825c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:04 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.info" returned: 0 in 0.415s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:04 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.info is being set with open permissions: ugo+rw Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:04 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.info Jul 30 16:33:04 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-0f092562-f4bb-47ae-963e-efc81342e751 req-d233758b-b7e6-4c83-ab50-4ec31ea9137d tempest-ServerActionsTestOtherA-1054032515 None] Terminate volume connection completed successfully. Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-0f092562-f4bb-47ae-963e-efc81342e751 req-d233758b-b7e6-4c83-ab50-4ec31ea9137d tempest-ServerActionsTestOtherA-1054032515 None] Deleting attachment 07500b64-5b2e-455f-90f2-8f18530f078c. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:04 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:33:04 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:05 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.info" returned: 0 in 0.459s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:05 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.089s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:33:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Deleted volume successfully. Jul 30 16:33:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f5d5027b-4763-42a0-b142-107ef77c6bb9 tempest-VolumesExtendTest-140455990 None] Create snapshot completed successfully Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c7485be5-fe66-4c16-9930-e5f381260908 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-d69225a5-60e1-4cd8-b7a1-0c1887414a38-delete_volume" released by "delete_volume" :: held 4.355s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "cinder-quobyte-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" acquired by "delete_volume" :: waited 0.034s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87d94d1-2caf-48db-a4f1-8ce4cd8cd03f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:05 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b Jul 30 16:33:05 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-0f092562-f4bb-47ae-963e-efc81342e751 req-d58a3f4d-f66c-4579-b74d-a20ed8d10ce6 tempest-ServerActionsTestOtherA-1054032515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-0f092562-f4bb-47ae-963e-efc81342e751 req-d58a3f4d-f66c-4579-b74d-a20ed8d10ce6 tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-0f092562-f4bb-47ae-963e-efc81342e751 req-d58a3f4d-f66c-4579-b74d-a20ed8d10ce6 tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-0f092562-f4bb-47ae-963e-efc81342e751 req-d58a3f4d-f66c-4579-b74d-a20ed8d10ce6 tempest-ServerActionsTestOtherA-1054032515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-7ec02579-a68d-4aef-8070-95de214fbe23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6e08738-fd36-4063-ac53-a2c30697726f', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:33:06 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-0f092562-f4bb-47ae-963e-efc81342e751 req-d58a3f4d-f66c-4579-b74d-a20ed8d10ce6 tempest-ServerActionsTestOtherA-1054032515 None] attachment_update completed successfully. Jul 30 16:33:06 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" returned: 0 in 0.515s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:06 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b Jul 30 16:33:06 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-47ee601a-8f24-4f49-9d40-af3d7a6fc7c8 tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-47ee601a-8f24-4f49-9d40-af3d7a6fc7c8 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:06 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-quobyte-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b" released by "delete_volume" :: held 0.949s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c3da25-4204-4a20-bf73-b1e6b91054d2]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-47ee601a-8f24-4f49-9d40-af3d7a6fc7c8 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Created reservations ['4fbc21d8-f74f-49ee-9ade-d86eff8af5a7', '03b0f2b1-86ce-449d-b967-0676662805d3', 'cacc3a39-f34a-4c6e-87f5-d1c6309fe1fa', 'a07fb786-6029-48ca-af13-b6f6d3ffe4a9'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:06 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 Jul 30 16:33:06 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:06 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:33:06 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:07 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-47ee601a-8f24-4f49-9d40-af3d7a6fc7c8 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8" returned: 0 in 0.628s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:07 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-47ee601a-8f24-4f49-9d40-af3d7a6fc7c8 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 2G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.459s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:33:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Deleted volume successfully. Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0be40dbc-7105-4097-b8ba-ac7d1442f963 tempest-VolumesDeleteCascade-1656848810 None] Lock "cinder-a7fa5336-4b0a-418c-ae0b-8f2d9cbdf22b-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-47ee601a-8f24-4f49-9d40-af3d7a6fc7c8 tempest-VolumesExtendTest-140455990 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 2G" returned: 0 in 0.244s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-47ee601a-8f24-4f49-9d40-af3d7a6fc7c8 tempest-VolumesExtendTest-140455990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.955s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-47ee601a-8f24-4f49-9d40-af3d7a6fc7c8 tempest-VolumesExtendTest-140455990 None] Extend volume completed successfully. Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Acquiring lock "cinder-0ca2623a-e3c3-48b4-903d-2f85997acec6-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Lock "cinder-0ca2623a-e3c3-48b4-903d-2f85997acec6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Acquiring lock "cinder-quobyte-99202525-bcb8-45b3-bee4-aff03b0b94b8" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Lock "cinder-quobyte-99202525-bcb8-45b3-bee4-aff03b0b94b8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Acquiring lock "cinder-quobyte-0ca2623a-e3c3-48b4-903d-2f85997acec6" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Lock "cinder-quobyte-0ca2623a-e3c3-48b4-903d-2f85997acec6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Deleting offline snapshot 0ca2623a-e3c3-48b4-903d-2f85997acec6 of volume 99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] snapshot_file for this snap is: volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[567423af-7336-4f53-b896-9ec580dabb02]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:08 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 Jul 30 16:33:08 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:08 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6" returned: 0 in 0.677s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99202525-bcb8-45b3-bee4-aff03b0b94b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0278ca9c-25e6-42cb-98ec-e5f2746ca331]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:09 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 Jul 30 16:33:09 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:09 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8" returned: 0 in 0.587s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:09 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 Jul 30 16:33:09 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:10 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6" returned: 0 in 0.682s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:10 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6 Jul 30 16:33:10 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:10 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8.0ca2623a-e3c3-48b4-903d-2f85997acec6" returned: 0 in 0.446s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Lock "cinder-quobyte-0ca2623a-e3c3-48b4-903d-2f85997acec6" released by "_delete_snapshot" :: held 2.657s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Lock "cinder-quobyte-99202525-bcb8-45b3-bee4-aff03b0b94b8" released by "delete_snapshot" :: held 2.701s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:10 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Created reservations ['a4f366c9-0c33-49e3-8499-acd4023847ee', '5e46ed97-3d58-4505-b81a-e3c418cd2425', '3805202e-dccb-4afd-9198-896751449f7a', '19fa17af-90f8-4748-8b39-dd222aa4641c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Delete snapshot completed successfully. Jul 30 16:33:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e5677dd2-6e49-4def-a46c-81a22db2facc tempest-VolumesExtendTest-140455990 None] Lock "cinder-0ca2623a-e3c3-48b4-903d-2f85997acec6-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Acquiring lock "cinder-99202525-bcb8-45b3-bee4-aff03b0b94b8-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Lock "cinder-99202525-bcb8-45b3-bee4-aff03b0b94b8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Acquiring lock "cinder-quobyte-99202525-bcb8-45b3-bee4-aff03b0b94b8" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Lock "cinder-quobyte-99202525-bcb8-45b3-bee4-aff03b0b94b8" acquired by "delete_volume" :: waited 0.050s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:11 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1983ec51-7ae5-4fd3-aada-b3c570eed9d7]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:12 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 Jul 30 16:33:12 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:12 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8" returned: 0 in 0.789s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:12 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8 Jul 30 16:33:12 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:12 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-99202525-bcb8-45b3-bee4-aff03b0b94b8" returned: 0 in 0.411s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Lock "cinder-quobyte-99202525-bcb8-45b3-bee4-aff03b0b94b8" released by "delete_volume" :: held 1.342s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Created reservations ['30ec3286-48bb-406a-bcdb-93a91bbdbe50', '0371bbc8-30fe-48af-8f3b-54603ed8b3a3', 'd46f25a3-2a72-4087-b555-38bc4c593036', 'b1dff99b-1304-46de-a872-d6c58c897b50'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:13 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:33:13 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:13 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.369s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:33:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Deleted volume successfully. Jul 30 16:33:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b8a876b2-1fd4-4873-8043-9ddd3c728465 tempest-VolumesExtendTest-140455990 None] Lock "cinder-99202525-bcb8-45b3-bee4-aff03b0b94b8-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Flow 'volume_create_manager' (27ed88e7-a1ed-4ccc-9e65-de300c477805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4c4bae-2e55-42d7-b92a-351c99d7ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4c4bae-2e55-42d7-b92a-351c99d7ddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1243812480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c932abc0-00b4-43d0-b7e2-3299b42ce3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15e553a420b449c9b663f5a0245091f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:21Z,use_quota=True,user_id='ec711882a3374bb697e891b220e1dfef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f91be52-61a9-47d7-a5b7-27ccd6ac1c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f91be52-61a9-47d7-a5b7-27ccd6ac1c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a107a3f-6236-4f3a-ae64-48c153b37329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a107a3f-6236-4f3a-ae64-48c153b37329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c932abc0-00b4-43d0-b7e2-3299b42ce3b2', 'volume_name': 'volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99f33d3-65f6-490e-9e8d-2d5565d050ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99f33d3-65f6-490e-9e8d-2d5565d050ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03cd141-b8c1-4a47-a6c3-787989b0eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:21 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2', 'volume_size': 1} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1243812480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c932abc0-00b4-43d0-b7e2-3299b42ce3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15e553a420b449c9b663f5a0245091f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:21Z,use_quota=True,user_id='ec711882a3374bb697e891b220e1dfef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Creating volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:33:21 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:21 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 1073741824 Jul 30 16:33:21 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:21 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 1073741824" returned: 0 in 0.687s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:22 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 Jul 30 16:33:22 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:22 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" returned: 0 in 0.436s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:33:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03cd141-b8c1-4a47-a6c3-787989b0eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1268a22c-2ee0-4cb8-865c-73261b6e8c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:22 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Volume volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 (c932abc0-00b4-43d0-b7e2-3299b42ce3b2): created successfully Jul 30 16:33:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1268a22c-2ee0-4cb8-865c-73261b6e8c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Flow 'volume_create_manager' (27ed88e7-a1ed-4ccc-9e65-de300c477805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:22 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-92e4946c-48c2-4e5e-a269-fc49228f3813 tempest-SnapshotsActionsTest-1860600053 None] Created volume successfully. Jul 30 16:33:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:23 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Creating offline snapshot b498a317-2107-44de-9eba-45287a9449ad of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:33:23 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede222a9-eb54-4162-ae70-c5c79149e974]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:23 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 Jul 30 16:33:23 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:24 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" returned: 0 in 0.515s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:24 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad 1G Jul 30 16:33:24 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:24 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad 1G" returned: 0 in 0.547s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:24 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:24 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:25 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.343s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:25 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad is being set with open permissions: ugo+rw Jul 30 16:33:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:25 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:25 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:25 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.275s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:25 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.info Jul 30 16:33:25 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:25 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.info" returned: 0 in 0.339s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:25 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.info is being set with open permissions: ugo+rw Jul 30 16:33:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:25 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.info Jul 30 16:33:25 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:26 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.info" returned: 0 in 0.304s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:26 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bdc21590-c9d0-44f4-abfc-23eb19fba97e tempest-SnapshotsActionsTest-1860600053 None] Create snapshot completed successfully Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Flow 'volume_create_manager' (635c8239-99fa-46d4-aff2-bebc481b0293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48144ed-0951-4dda-9de3-c278d78084d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Creating offline snapshot 9e741e98-8c44-4a10-be73-315005846b65 of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48144ed-0951-4dda-9de3-c278d78084d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-348227706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c833e0-6048-42ee-b15c-8f1489df7d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874474b5a5c24614bff86206c55d7d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:28Z,use_quota=True,user_id='6cefa3dc89ff45bdb3b5148bd78d43e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e81a14-e0c0-4463-8ef7-d6ece93331a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e81a14-e0c0-4463-8ef7-d6ece93331a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff71f2e-b419-406a-bef0-7df0a464fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff71f2e-b419-406a-bef0-7df0a464fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c833e0-6048-42ee-b15c-8f1489df7d12', 'volume_name': 'volume-24c833e0-6048-42ee-b15c-8f1489df7d12', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df592c63-0ae6-4f51-a441-4dd3811f0f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df592c63-0ae6-4f51-a441-4dd3811f0f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820f0687-2d05-474c-936e-cc22d5c9d012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:27 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Volume 24c833e0-6048-42ee-b15c-8f1489df7d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c833e0-6048-42ee-b15c-8f1489df7d12', 'volume_size': 1} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[daac0f79-fb31-45a4-8588-d87943e09494]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:28 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:28 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:28 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.457s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:28 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 1G Jul 30 16:33:28 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:29 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 1G" returned: 0 in 0.599s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:29 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 Jul 30 16:33:29 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:29 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65" returned: 0 in 0.334s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:29 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 is being set with open permissions: ugo+rw Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:29 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 Jul 30 16:33:29 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:29 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-348227706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c833e0-6048-42ee-b15c-8f1489df7d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874474b5a5c24614bff86206c55d7d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:28Z,use_quota=True,user_id='6cefa3dc89ff45bdb3b5148bd78d43e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Creating volume 24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:33:29 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:33:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:29 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 1073741824 Jul 30 16:33:29 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:29 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8ccfa640-ff13-4b45-b7f1-1544e6f5e7d7 tempest-SnapshotsActionsTest-1860600053 None] Create snapshot completed successfully Jul 30 16:33:30 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 1073741824" returned: 0 in 0.546s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:30 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:33:30 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:30 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.271s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820f0687-2d05-474c-936e-cc22d5c9d012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c833e0-6048-42ee-b15c-8f1489df7d12', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe00a7fa-7526-460c-953d-8b32b157c73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Volume volume-24c833e0-6048-42ee-b15c-8f1489df7d12 (24c833e0-6048-42ee-b15c-8f1489df7d12): created successfully Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe00a7fa-7526-460c-953d-8b32b157c73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Flow 'volume_create_manager' (635c8239-99fa-46d4-aff2-bebc481b0293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-28958f3a-1ad0-4ba8-b1c0-f354977f17c8 tempest-VolumesActionsTest-1176375295 None] Created volume successfully. Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-9e741e98-8c44-4a10-be73-315005846b65-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-9e741e98-8c44-4a10-be73-315005846b65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-quobyte-9e741e98-8c44-4a10-be73-315005846b65" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-9e741e98-8c44-4a10-be73-315005846b65" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Deleting offline snapshot 9e741e98-8c44-4a10-be73-315005846b65 of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] snapshot_file for this snap is: volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9aec2b-1ca4-4a7c-ac51-7bddc830a942]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:31 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 Jul 30 16:33:31 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:31 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65" returned: 0 in 0.478s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[85632f69-ebd7-4d0a-9099-88fc4a2f58ba]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:31 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:31 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:32 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.501s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:32 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 Jul 30 16:33:32 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:32 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65" returned: 0 in 0.613s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:32 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65 Jul 30 16:33:32 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:33 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.9e741e98-8c44-4a10-be73-315005846b65" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-9e741e98-8c44-4a10-be73-315005846b65" released by "_delete_snapshot" :: held 2.223s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" released by "delete_snapshot" :: held 2.265s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:33 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Created reservations ['6719ebdb-aa6b-4d84-8fd5-7e50aaba7ac1', 'd1368f9c-08b4-4e37-b3c2-c8d6eafbe471', '884d5319-040a-40de-b92b-b549379523ac', '092142c6-b1f1-4cfb-b1e5-5627b00a6754'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Delete snapshot completed successfully. Jul 30 16:33:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8fae8483-00c6-4cc3-9b22-42c1eada49e0 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-9e741e98-8c44-4a10-be73-315005846b65-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=124,cinder:INSERT=38,cinder:UPDATE=137,cinder:DELETE=9 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (bde5e6cd-8f8d-4920-a9fc-45c6d9440c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b945c7-fd7f-446f-90e3-faddd1d468d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b945c7-fd7f-446f-90e3-faddd1d468d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-882690675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e18eacc-2cd1-4e4b-a429-eb389eb78ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b13a092134a9e90e69e3a995edb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:34Z,use_quota=True,user_id='0791d74076a246d282c03503472228d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e0c101-c91f-4b66-a8f5-c5d955ad88a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e0c101-c91f-4b66-a8f5-c5d955ad88a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fc41a2-756d-4d80-9df0-5f10ee7c365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fc41a2-756d-4d80-9df0-5f10ee7c365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e18eacc-2cd1-4e4b-a429-eb389eb78ffa', 'volume_name': 'volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36ee486-09a5-4978-9212-2fdbb264f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36ee486-09a5-4978-9212-2fdbb264f823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100462f6-1ccd-4cb1-a35d-6a889ad2bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:34 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Volume 8e18eacc-2cd1-4e4b-a429-eb389eb78ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa', 'volume_size': 1} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-882690675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e18eacc-2cd1-4e4b-a429-eb389eb78ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b13a092134a9e90e69e3a995edb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:34Z,use_quota=True,user_id='0791d74076a246d282c03503472228d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Creating volume 8e18eacc-2cd1-4e4b-a429-eb389eb78ffa {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:33:34 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:34 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa 1073741824 Jul 30 16:33:34 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=133,cinder:SELECT=133,cinder:DELETE=12,cinder:INSERT=41 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:33:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:35 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa 1073741824" returned: 0 in 0.752s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:35 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa Jul 30 16:33:35 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:35 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.894s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Creating offline snapshot 5f7a1bf2-dfe6-438c-8266-c0e1426742ec of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100462f6-1ccd-4cb1-a35d-6a889ad2bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71c272f-8200-4939-8780-e2a9465a3def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d81e0d-19f5-4e66-941d-f49afca4cf5b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Volume volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa (8e18eacc-2cd1-4e4b-a429-eb389eb78ffa): created successfully Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71c272f-8200-4939-8780-e2a9465a3def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (bde5e6cd-8f8d-4920-a9fc-45c6d9440c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4ced8cca-66dd-4939-be9d-3e6fb0d543a5 tempest-VolumesSnapshotTestJSON-355278868 None] Created volume successfully. Jul 30 16:33:35 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:35 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-7c91f1b5-e132-4b56-9574-1ba5186eb84f req-f70688e3-446c-478c-a97c-887be2442fd4 tempest-ServerActionsTestOtherA-1054032515 None] Terminate volume connection completed successfully. Jul 30 16:33:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-7c91f1b5-e132-4b56-9574-1ba5186eb84f req-f70688e3-446c-478c-a97c-887be2442fd4 tempest-ServerActionsTestOtherA-1054032515 None] Deleting attachment a6e08738-fd36-4063-ac53-a2c30697726f. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:33:36 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.462s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:36 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec 1G Jul 30 16:33:36 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:36 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec 1G" returned: 0 in 0.670s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:36 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec Jul 30 16:33:36 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:37 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec" returned: 0 in 0.481s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:37 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec is being set with open permissions: ugo+rw Jul 30 16:33:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:37 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec Jul 30 16:33:37 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:37 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec" returned: 0 in 0.346s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.066s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Creating offline snapshot 2725c076-1513-47fa-8551-bc560ab926a0 of volume 8e18eacc-2cd1-4e4b-a429-eb389eb78ffa {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:33:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ce11dc5a-1ffe-422f-9146-88c39b362c4b tempest-SnapshotsActionsTest-1860600053 None] Create snapshot completed successfully Jul 30 16:33:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e4385a-0a99-4031-8a22-92d6eaa69643]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:38 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa Jul 30 16:33:38 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:38 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" returned: 0 in 0.645s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:38 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 1G Jul 30 16:33:38 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-5f7a1bf2-dfe6-438c-8266-c0e1426742ec-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:39 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 1G" returned: 0 in 0.810s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:39 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 Jul 30 16:33:39 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-5f7a1bf2-dfe6-438c-8266-c0e1426742ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-quobyte-5f7a1bf2-dfe6-438c-8266-c0e1426742ec" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-5f7a1bf2-dfe6-438c-8266-c0e1426742ec" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Deleting offline snapshot 5f7a1bf2-dfe6-438c-8266-c0e1426742ec of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] snapshot_file for this snap is: volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c20c7a6-b293-480d-821d-6a93575eeec0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:39 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec Jul 30 16:33:39 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:39 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0" returned: 0 in 0.537s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:39 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 is being set with open permissions: ugo+rw Jul 30 16:33:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:39 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 Jul 30 16:33:39 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:40 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0" returned: 0 in 0.409s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:40 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec" returned: 0 in 0.784s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[593764c3-fbee-4ddf-a9be-2382b37d5e97]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:40 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.info Jul 30 16:33:40 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:40 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:40 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:40 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.info" returned: 0 in 0.345s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:40 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.info is being set with open permissions: ugo+rw Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:40 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.info Jul 30 16:33:40 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:40 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.561s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:41 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec Jul 30 16:33:41 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:41 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.info" returned: 0 in 0.380s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.346s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:41 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2fe934ba-1193-4471-a24b-9f83e18f3ea6 tempest-VolumesSnapshotTestJSON-355278868 None] Create snapshot completed successfully Jul 30 16:33:41 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec" returned: 0 in 0.490s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:41 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec Jul 30 16:33:41 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:41 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.5f7a1bf2-dfe6-438c-8266-c0e1426742ec" returned: 0 in 0.373s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-5f7a1bf2-dfe6-438c-8266-c0e1426742ec" released by "_delete_snapshot" :: held 2.395s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" released by "delete_snapshot" :: held 2.436s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:41 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Created reservations ['048e349d-f588-42a0-a67a-aeadeb4827e1', '732df1c0-a6b9-4eb6-8c3b-1127e7697c6c', '19030c75-f039-45cb-b571-57312f7b31c9', '45da23c2-98fd-412d-9731-be14c10133d9'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:42 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Delete snapshot completed successfully. Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-810a7b33-88fc-42af-9535-682db4f4ca85 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-5f7a1bf2-dfe6-438c-8266-c0e1426742ec-delete_snapshot" released by "delete_snapshot" :: held 2.688s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-2725c076-1513-47fa-8551-bc560ab926a0-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-2725c076-1513-47fa-8551-bc560ab926a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-2725c076-1513-47fa-8551-bc560ab926a0" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-2725c076-1513-47fa-8551-bc560ab926a0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Deleting offline snapshot 2725c076-1513-47fa-8551-bc560ab926a0 of volume 8e18eacc-2cd1-4e4b-a429-eb389eb78ffa {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] snapshot_file for this snap is: volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0753bde-56f1-4fa9-9405-059863b633b6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8cce9cec-4b42-45c6-a105-ab1b1cb3478e tempest-VolumesActionsTest-1176375295 None] Acquiring lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12" by "attach_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:42 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 Jul 30 16:33:42 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8cce9cec-4b42-45c6-a105-ab1b1cb3478e tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12" acquired by "attach_volume" :: waited 0.042s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:42 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8cce9cec-4b42-45c6-a105-ab1b1cb3478e tempest-VolumesActionsTest-1176375295 None] Attaching volume 24c833e0-6048-42ee-b15c-8f1489df7d12 to instance 8e05e8a0-e0bb-408f-9786-ec62d24c78b0 at mountpoint /dev/vdb on host None. Jul 30 16:33:42 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8cce9cec-4b42-45c6-a105-ab1b1cb3478e tempest-VolumesActionsTest-1176375295 None] Attach volume completed successfully. Jul 30 16:33:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8cce9cec-4b42-45c6-a105-ab1b1cb3478e tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12" released by "attach_volume" :: held 0.184s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Acquiring lock "cinder-7ec02579-a68d-4aef-8070-95de214fbe23-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:43 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Lock "cinder-7ec02579-a68d-4aef-8070-95de214fbe23-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0" returned: 0 in 0.667s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8924dc51-6497-465d-97d4-eadacf3b914e tempest-VolumesActionsTest-1176375295 None] Acquiring lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-detach_volume" by "detach_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d30d9d9-2c34-40d9-952d-75956f2143e9]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8924dc51-6497-465d-97d4-eadacf3b914e tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-detach_volume" acquired by "detach_volume" :: waited 0.075s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8924dc51-6497-465d-97d4-eadacf3b914e tempest-VolumesActionsTest-1176375295 None] Detaching volume 24c833e0-6048-42ee-b15c-8f1489df7d12 from instance 8e05e8a0-e0bb-408f-9786-ec62d24c78b0. Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:43 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa Jul 30 16:33:43 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Acquiring lock "cinder-quobyte-7ec02579-a68d-4aef-8070-95de214fbe23" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Creating offline snapshot 6860e0c4-21b2-424d-a513-b68b9c4cf557 of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0291c-b57b-4d75-9836-105a937328d1]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Lock "cinder-quobyte-7ec02579-a68d-4aef-8070-95de214fbe23" acquired by "delete_volume" :: waited 0.094s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6ae2e3-c932-4288-8774-170d47f5796f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8924dc51-6497-465d-97d4-eadacf3b914e tempest-VolumesActionsTest-1176375295 None] Detach volume completed successfully. Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8924dc51-6497-465d-97d4-eadacf3b914e tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-detach_volume" released by "detach_volume" :: held 0.300s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:43 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:43 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:43 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 Jul 30 16:33:43 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:43 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" returned: 0 in 0.471s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:43 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 Jul 30 16:33:43 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:44 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.548s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:44 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 1G Jul 30 16:33:44 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:44 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23" returned: 0 in 0.656s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:44 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23 Jul 30 16:33:44 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:44 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0" returned: 0 in 0.649s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:44 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0 Jul 30 16:33:44 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:44 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7ec02579-a68d-4aef-8070-95de214fbe23" returned: 0 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Lock "cinder-quobyte-7ec02579-a68d-4aef-8070-95de214fbe23" released by "delete_volume" :: held 1.050s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Created reservations ['394038b8-1247-4915-8ca2-1430d4dde4a3', '861d0cba-03f8-4b6f-9976-8e90779fa3a4', '328a1c63-94a7-4085-b7c2-1738f3e0651b', '893d0043-7c70-4484-84fd-7ee412e8e2ed'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:44 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 1G" returned: 0 in 0.679s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:44 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 Jul 30 16:33:44 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:44 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa.2725c076-1513-47fa-8551-bc560ab926a0" returned: 0 in 0.437s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:44 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:33:44 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-2725c076-1513-47fa-8551-bc560ab926a0" released by "_delete_snapshot" :: held 2.431s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" released by "delete_snapshot" :: held 2.470s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Created reservations ['d62ba2ac-0a1d-4176-9d61-84ed272c0148', '7e4c1cdb-41f3-4e04-8368-8f9474a09fc4', '34efd117-ff1d-481e-8fc6-6b923a39297a', '42a0af67-a28b-4f39-977c-1aa29d130c89'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Delete snapshot completed successfully. Jul 30 16:33:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d351cff6-4431-45ff-8442-0b3bdc23359f tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-2725c076-1513-47fa-8551-bc560ab926a0-delete_snapshot" released by "delete_snapshot" :: held 2.692s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:45 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:45 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 is being set with open permissions: ugo+rw Jul 30 16:33:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:45 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.358s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:45 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:33:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Deleted volume successfully. Jul 30 16:33:45 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 Jul 30 16:33:45 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a528f57-5511-4240-b440-c8b13f098a88 tempest-ServerActionsTestOtherA-1054032515 None] Lock "cinder-7ec02579-a68d-4aef-8070-95de214fbe23-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:45 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557" returned: 0 in 0.368s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c55405a0-3a91-4a2f-b83b-114f9e936978 tempest-SnapshotsActionsTest-1860600053 None] Create snapshot completed successfully Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (b6ca3364-29a0-4b1a-94c9-ec719df1bf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4ec87f-fadc-46df-9ed0-89106bea304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4ec87f-fadc-46df-9ed0-89106bea304c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-947899993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f068ee5b-7c03-4bf7-aa6a-4b464186fa18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b13a092134a9e90e69e3a995edb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:46Z,use_quota=True,user_id='0791d74076a246d282c03503472228d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab041d06-71e7-4972-bebb-a06d456faaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab041d06-71e7-4972-bebb-a06d456faaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf228711-cbb7-4b04-b1cc-845b9cdb62d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf228711-cbb7-4b04-b1cc-845b9cdb62d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f068ee5b-7c03-4bf7-aa6a-4b464186fa18', 'volume_name': 'volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d01d32-c966-4d80-86fb-787ec8a6c81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d01d32-c966-4d80-86fb-787ec8a6c81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a83e31-dac3-4e44-b04e-0794567f6aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:46 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Volume f068ee5b-7c03-4bf7-aa6a-4b464186fa18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18', 'volume_size': 1} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-947899993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f068ee5b-7c03-4bf7-aa6a-4b464186fa18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b13a092134a9e90e69e3a995edb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:46Z,use_quota=True,user_id='0791d74076a246d282c03503472228d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Creating volume f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:33:46 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-6860e0c4-21b2-424d-a513-b68b9c4cf557-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-6860e0c4-21b2-424d-a513-b68b9c4cf557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:46 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 1073741824 Jul 30 16:33:46 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-quobyte-6860e0c4-21b2-424d-a513-b68b9c4cf557" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-6860e0c4-21b2-424d-a513-b68b9c4cf557" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Deleting offline snapshot 6860e0c4-21b2-424d-a513-b68b9c4cf557 of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] snapshot_file for this snap is: volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca3fa31-bb57-42ad-a364-f0c489d6f93b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:46 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 Jul 30 16:33:46 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:47 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557" returned: 0 in 0.515s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:47 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 1073741824" returned: 0 in 0.711s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d04202-ee51-4633-b06e-ceb8fd2f5acf]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:47 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:33:47 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:47 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 Jul 30 16:33:47 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:47 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:47 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:47 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.420s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:33:47 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.508s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:47 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 Jul 30 16:33:47 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:47 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" returned: 0 in 0.486s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a83e31-dac3-4e44-b04e-0794567f6aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223ba3b5-893e-483e-8125-6e7e37f2e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:48 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Volume volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 (f068ee5b-7c03-4bf7-aa6a-4b464186fa18): created successfully Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223ba3b5-893e-483e-8125-6e7e37f2e883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (b6ca3364-29a0-4b1a-94c9-ec719df1bf3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3f529770-93de-41f4-8865-cfaa1e44f682 tempest-VolumesSnapshotTestJSON-355278868 None] Created volume successfully. Jul 30 16:33:48 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557" returned: 0 in 0.575s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:48 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557 Jul 30 16:33:48 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Creating offline snapshot 5c269757-7c00-41a3-baa6-9ac989084060 of volume f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[832f6a1c-fcc3-4364-8815-99a28b5a671a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:48 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 Jul 30 16:33:48 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:48 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.6860e0c4-21b2-424d-a513-b68b9c4cf557" returned: 0 in 0.396s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-6860e0c4-21b2-424d-a513-b68b9c4cf557" released by "_delete_snapshot" :: held 2.180s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" released by "delete_snapshot" :: held 2.210s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:49 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Created reservations ['e182c930-9c32-4c73-9c3b-2cc1e959524b', 'd57a5492-24ce-49aa-9073-f36fa6ee1bdb', '140d08f8-cfcf-4b67-82b0-9dead8abc466', '12b6398f-3911-4e21-8f20-1390858cda90'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:33:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Delete snapshot completed successfully. Jul 30 16:33:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17bf40e8-5de5-49f1-b9ad-7acf600fe493 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-6860e0c4-21b2-424d-a513-b68b9c4cf557-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:49 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" returned: 0 in 0.461s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:49 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 1G Jul 30 16:33:49 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:49 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 1G" returned: 0 in 0.595s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:49 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 Jul 30 16:33:49 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:50 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060" returned: 0 in 0.427s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:50 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 is being set with open permissions: ugo+rw Jul 30 16:33:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:50 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 Jul 30 16:33:50 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:50 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060" returned: 0 in 0.447s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:50 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.info Jul 30 16:33:50 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:51 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.info" returned: 0 in 0.309s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:51 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.info is being set with open permissions: ugo+rw Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:51 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.info Jul 30 16:33:51 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:51 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.info" returned: 0 in 0.259s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.879s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Creating offline snapshot eb01c882-7504-484d-98ee-e10404e4d1de of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:33:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4133e9eb-cb7d-4a53-8211-e8334091ab1b tempest-VolumesSnapshotTestJSON-355278868 None] Create snapshot completed successfully Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e55960-2a1c-4b7c-ba1f-403ec806eae5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:51 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:51 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:51 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.471s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:51 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de 1G Jul 30 16:33:51 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:52 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de 1G" returned: 0 in 0.702s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:52 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de Jul 30 16:33:52 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (45366c81-db82-4f24-9f36-c42e3b2d4bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a27f37-ae4a-4539-a0d5-3f535715e027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a27f37-ae4a-4539-a0d5-3f535715e027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1184081139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53218c0c-3eaf-468f-b0db-4621623c86ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b13a092134a9e90e69e3a995edb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:33:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5c269757-7c00-41a3-baa6-9ac989084060,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:33:53Z,use_quota=True,user_id='0791d74076a246d282c03503472228d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdf6cb5-a2e2-4c6f-81aa-7fcbe6a8705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdf6cb5-a2e2-4c6f-81aa-7fcbe6a8705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65a0a6e-6039-4111-be62-6b4198b25f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65a0a6e-6039-4111-be62-6b4198b25f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53218c0c-3eaf-468f-b0db-4621623c86ab', 'volume_name': 'volume-53218c0c-3eaf-468f-b0db-4621623c86ab', 'volume_size': 2, 'snapshot_id': '5c269757-7c00-41a3-baa6-9ac989084060'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198e0254-f187-42bf-b43f-85b3f41b3a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198e0254-f187-42bf-b43f-85b3f41b3a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e527b06-a7c9-4943-b1df-003a558aca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:33:52 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Volume 53218c0c-3eaf-468f-b0db-4621623c86ab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53218c0c-3eaf-468f-b0db-4621623c86ab', 'volume_size': 2, 'snapshot_id': '5c269757-7c00-41a3-baa6-9ac989084060'} Jul 30 16:33:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:53 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de" returned: 0 in 0.504s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:53 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de is being set with open permissions: ugo+rw Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:53 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de Jul 30 16:33:53 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de" returned: 0 in 0.489s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:53 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.788s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-5c269757-7c00-41a3-baa6-9ac989084060-53218c0c-3eaf-468f-b0db-4621623c86ab" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-5c269757-7c00-41a3-baa6-9ac989084060-53218c0c-3eaf-468f-b0db-4621623c86ab" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Creating volume 53218c0c-3eaf-468f-b0db-4621623c86ab from snapshot 5c269757-7c00-41a3-baa6-9ac989084060 {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-53218c0c-3eaf-468f-b0db-4621623c86ab" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:53 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7f77d3fa-3b30-4e2a-abd5-438476f977da tempest-SnapshotsActionsTest-1860600053 None] Create snapshot completed successfully Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-53218c0c-3eaf-468f-b0db-4621623c86ab" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] snapshot: 5c269757-7c00-41a3-baa6-9ac989084060, volume: 53218c0c-3eaf-468f-b0db-4621623c86ab, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b32215-abf9-469f-bb2a-6bcd1f162917]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:54 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 Jul 30 16:33:54 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:54 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060" returned: 0 in 0.442s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1108974-34f9-466d-b51c-c8ff00a41a84]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:54 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 Jul 30 16:33:54 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:54 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" returned: 0 in 0.437s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:33:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:54 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab Jul 30 16:33:54 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-eb01c882-7504-484d-98ee-e10404e4d1de-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-eb01c882-7504-484d-98ee-e10404e4d1de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Acquiring lock "cinder-quobyte-eb01c882-7504-484d-98ee-e10404e4d1de" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-eb01c882-7504-484d-98ee-e10404e4d1de" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Deleting offline snapshot eb01c882-7504-484d-98ee-e10404e4d1de of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] snapshot_file for this snap is: volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[60645e9a-8627-46d9-800b-1fa28c1e016c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:55 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de Jul 30 16:33:55 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:56 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de" returned: 0 in 1.030s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82ed446-b477-4ea7-b02f-427addf18956]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:33:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:56 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:33:56 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:57 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 1.297s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:33:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:57 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de Jul 30 16:33:57 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-085ca01b-3c0d-445d-bff4-0bdee1f86f39 tempest-VolumesActionsTest-1176375295 None] Acquiring lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12" by "attach_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:33:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-085ca01b-3c0d-445d-bff4-0bdee1f86f39 tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12" acquired by "attach_volume" :: waited 0.062s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:33:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-085ca01b-3c0d-445d-bff4-0bdee1f86f39 tempest-VolumesActionsTest-1176375295 None] Attaching volume 24c833e0-6048-42ee-b15c-8f1489df7d12 to instance 7d05a70b-b6d2-460d-9f74-c840c684fdbb at mountpoint /dev/vdb on host None. Jul 30 16:33:59 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de" returned: 0 in 1.859s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-085ca01b-3c0d-445d-bff4-0bdee1f86f39 tempest-VolumesActionsTest-1176375295 None] Attach volume completed successfully. Jul 30 16:33:59 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de Jul 30 16:33:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-085ca01b-3c0d-445d-bff4-0bdee1f86f39 tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12" released by "attach_volume" :: held 0.249s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:33:59 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:00 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.eb01c882-7504-484d-98ee-e10404e4d1de" returned: 0 in 0.757s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-be725bec-1797-49d4-adbe-6bbcb05b2256 tempest-VolumesActionsTest-1176375295 None] Acquiring lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-detach_volume" by "detach_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-eb01c882-7504-484d-98ee-e10404e4d1de" released by "_delete_snapshot" :: held 5.212s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" released by "delete_snapshot" :: held 5.274s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-be725bec-1797-49d4-adbe-6bbcb05b2256 tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-detach_volume" acquired by "detach_volume" :: waited 0.084s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-be725bec-1797-49d4-adbe-6bbcb05b2256 tempest-VolumesActionsTest-1176375295 None] Detaching volume 24c833e0-6048-42ee-b15c-8f1489df7d12 from instance 7d05a70b-b6d2-460d-9f74-c840c684fdbb. Jul 30 16:34:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-be725bec-1797-49d4-adbe-6bbcb05b2256 tempest-VolumesActionsTest-1176375295 None] Detach volume completed successfully. Jul 30 16:34:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-be725bec-1797-49d4-adbe-6bbcb05b2256 tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-detach_volume" released by "detach_volume" :: held 0.426s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:00 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Created reservations ['2f8c9b29-1d3b-451c-9bb6-de8f7481ed9f', '032a79ff-ae29-4676-aa78-10b00aff911c', '928cbbd6-adad-4a9c-95f4-295daa742907', '43c3919c-37e0-4e69-8440-f1140db35724'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Delete snapshot completed successfully. Jul 30 16:34:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9ddba324-dbd3-4dba-b678-1c70333be0a6 tempest-SnapshotsActionsTest-1524007504 None] Lock "cinder-eb01c882-7504-484d-98ee-e10404e4d1de-delete_snapshot" released by "delete_snapshot" :: held 6.237s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:02 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab" returned: 0 in 7.911s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:02 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18, size 1024.00 MB, duration 7.91 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:34:02 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Converted 1024.00 MB image at 129.39 MB/s Jul 30 16:34:02 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab is being set with open permissions: ugo+rw Jul 30 16:34:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:02 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab Jul 30 16:34:02 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:03 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab" returned: 0 in 0.463s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-53218c0c-3eaf-468f-b0db-4621623c86ab" released by "_copy_volume_from_snapshot" :: held 9.372s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-5c269757-7c00-41a3-baa6-9ac989084060-53218c0c-3eaf-468f-b0db-4621623c86ab" released by "_create_volume_from_snapshot" :: held 9.471s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.498s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "cinder-b498a317-2107-44de-9eba-45287a9449ad-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e527b06-a7c9-4943-b1df-003a558aca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53218c0c-3eaf-468f-b0db-4621623c86ab', 'volume_size': 2, 'snapshot_id': '5c269757-7c00-41a3-baa6-9ac989084060'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e93894a-233b-48e3-8785-02155c6e1183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-b498a317-2107-44de-9eba-45287a9449ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:03 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Volume volume-53218c0c-3eaf-468f-b0db-4621623c86ab (53218c0c-3eaf-468f-b0db-4621623c86ab): created successfully Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e93894a-233b-48e3-8785-02155c6e1183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (45366c81-db82-4f24-9f36-c42e3b2d4bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "cinder-quobyte-b498a317-2107-44de-9eba-45287a9449ad" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:03 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9e10e086-ee8d-4a42-baf5-d61ca94d55bf tempest-VolumesSnapshotTestJSON-355278868 None] Created volume successfully. Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-quobyte-b498a317-2107-44de-9eba-45287a9449ad" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Deleting offline snapshot b498a317-2107-44de-9eba-45287a9449ad of volume c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] snapshot_file for this snap is: volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae89ca6e-744b-4f5d-b146-ac92707192a8]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:03 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:34:03 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-53218c0c-3eaf-468f-b0db-4621623c86ab-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-53218c0c-3eaf-468f-b0db-4621623c86ab-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-53218c0c-3eaf-468f-b0db-4621623c86ab" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-53218c0c-3eaf-468f-b0db-4621623c86ab" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a39636a-acd7-4929-ba57-67ffdf3e1875]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:04 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.781s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ba4fbd-981f-4271-89d8-fa55d31534fc]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:04 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab Jul 30 16:34:04 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:04 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 Jul 30 16:34:04 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:04 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab" returned: 0 in 0.614s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:04 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" returned: 0 in 0.449s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:04 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab Jul 30 16:34:04 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:04 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:34:04 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:05 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-53218c0c-3eaf-468f-b0db-4621623c86ab" returned: 0 in 0.337s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-53218c0c-3eaf-468f-b0db-4621623c86ab" released by "delete_volume" :: held 1.042s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Created reservations ['e6c89080-a0e8-41d7-8e62-e6ea853fef59', 'ca929233-d91f-41cf-b11b-d44067a3faed', 'f652dc78-59d1-4612-ade5-dafa23a7f080', '306ad4df-e2d9-4b4f-bae8-10c9fb7c45ff'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:05 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.497s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:05 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad Jul 30 16:34:05 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:05 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:34:05 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:05 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2.b498a317-2107-44de-9eba-45287a9449ad" returned: 0 in 0.365s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:05 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-quobyte-b498a317-2107-44de-9eba-45287a9449ad" released by "_delete_snapshot" :: held 2.304s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Deleted volume successfully. Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" released by "delete_snapshot" :: held 2.359s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6b41b3f9-a921-458c-94bb-cf5809fab4b1 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-53218c0c-3eaf-468f-b0db-4621623c86ab-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Created reservations ['7c9da75c-a50d-4ac3-ae2a-46a1c3675971', 'f0a81d96-56b2-4292-a8e9-186832cb19cd', '0914fdef-2902-4a41-86ec-e6e39b0675a3', 'ffa9431d-fdb7-4012-b7b9-ea43b1dbe6e5'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Delete snapshot completed successfully. Jul 30 16:34:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-550e0d85-bb2c-40d5-aff7-877da9ec4ee8 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-b498a317-2107-44de-9eba-45287a9449ad-delete_snapshot" released by "delete_snapshot" :: held 2.541s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-5c269757-7c00-41a3-baa6-9ac989084060-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-5c269757-7c00-41a3-baa6-9ac989084060-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-5c269757-7c00-41a3-baa6-9ac989084060" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-5c269757-7c00-41a3-baa6-9ac989084060" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Deleting offline snapshot 5c269757-7c00-41a3-baa6-9ac989084060 of volume f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] snapshot_file for this snap is: volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c754fc-d695-4c46-9192-94ab2ff61e1c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:06 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 Jul 30 16:34:06 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "cinder-c932abc0-00b4-43d0-b7e2-3299b42ce3b2-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-c932abc0-00b4-43d0-b7e2-3299b42ce3b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" acquired by "delete_volume" :: waited 0.027s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c8d1c5-3ef9-459d-bb9f-94f1dc85b970]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:06 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060" returned: 0 in 0.490s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e826d0-4ac2-46e8-af7f-106d3aa5ebff]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:06 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 Jul 30 16:34:06 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:06 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 Jul 30 16:34:06 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1906eb-94ba-4699-a056-6144064dfcce]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:07 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" returned: 0 in 0.472s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:07 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2 Jul 30 16:34:07 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:07 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:34:07 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:07 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" returned: 0 in 0.625s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:07 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 Jul 30 16:34:07 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:07 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" returned: 0 in 0.330s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-quobyte-c932abc0-00b4-43d0-b7e2-3299b42ce3b2" released by "delete_volume" :: held 0.892s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:07 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Created reservations ['bb8ee19f-ea5f-4cb0-8ea7-7e68031f038f', '294e0385-93bd-4bc6-b545-4f9e9cc5aec5', 'fa232db4-7b85-406c-9468-6c2b5ad7f170', '801032f7-a2ac-46f1-9f21-23325e71b28b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.445s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[097727f7-cfef-4456-bfd5-4192acfe508d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:07 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:34:07 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:07 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:34:07 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:08 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060" returned: 0 in 0.570s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:08 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060 Jul 30 16:34:08 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:08 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.386s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Deleted volume successfully. Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-341aa536-00af-490a-84fb-5379593fe081 tempest-SnapshotsActionsTest-1860600053 None] Lock "cinder-c932abc0-00b4-43d0-b7e2-3299b42ce3b2-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:08 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.554s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.83f9f9a3-71a4-4220-b000-4ee6e6955469cob1w805.img {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:08 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.83f9f9a3-71a4-4220-b000-4ee6e6955469cob1w805.img Jul 30 16:34:08 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:08 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18.5c269757-7c00-41a3-baa6-9ac989084060" returned: 0 in 0.359s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-5c269757-7c00-41a3-baa6-9ac989084060" released by "_delete_snapshot" :: held 2.176s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" released by "delete_snapshot" :: held 2.199s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Created reservations ['6f36c7f4-2821-4f61-a83b-c024feb5ca47', 'fb927c0a-fa22-4914-adfa-dac016e630b1', 'fe17b3d2-0ddf-494e-8f12-ce22589f3014', 'f915f933-d49f-4d00-94a5-e7afb83351a9'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Delete snapshot completed successfully. Jul 30 16:34:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee895bbd-e0cb-43ed-8d68-02e12b5aa941 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-5c269757-7c00-41a3-baa6-9ac989084060-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-f068ee5b-7c03-4bf7-aa6a-4b464186fa18-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-f068ee5b-7c03-4bf7-aa6a-4b464186fa18-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" acquired by "delete_volume" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2809873b-1da3-4891-85c2-68527c743613]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:10 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 Jul 30 16:34:10 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:11 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" returned: 0 in 1.036s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:11 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18 Jul 30 16:34:11 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:12 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" returned: 0 in 0.826s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-f068ee5b-7c03-4bf7-aa6a-4b464186fa18" released by "delete_volume" :: held 2.080s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Created reservations ['e7fabc5e-8256-4992-b482-669d29176b95', '5e7027f4-330f-4681-9753-6d73b920daa4', '74ba47e0-2cd9-45e7-a852-aa281a430a33', '56eea380-da46-4e17-ba13-a31800c83c65'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:12 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:34:12 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:13 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.424s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:13 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Deleted volume successfully. Jul 30 16:34:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f1c640da-ac65-4bbc-9d9e-8d8b1394f9aa tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-f068ee5b-7c03-4bf7-aa6a-4b464186fa18-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:14 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.83f9f9a3-71a4-4220-b000-4ee6e6955469cob1w805.img" returned: 0 in 5.963s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:14 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3989c-06c2-4697-9fb6-5235fd240e88]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:14 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:34:14 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:14 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:34:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (bd62eaaa-3561-4cb4-9001-38a55d0c3b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b600c5c4-dc0c-4ade-9c1e-9d61566f3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b600c5c4-dc0c-4ade-9c1e-9d61566f3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-248206356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433d5d54-5c96-44d8-b2d0-550d17dde649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b13a092134a9e90e69e3a995edb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:15Z,use_quota=True,user_id='0791d74076a246d282c03503472228d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ac8451-6d59-4fc8-a4e1-583d80922176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ac8451-6d59-4fc8-a4e1-583d80922176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3c9665-c7ff-4e59-99a1-55e7b69cc115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3c9665-c7ff-4e59-99a1-55e7b69cc115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433d5d54-5c96-44d8-b2d0-550d17dde649', 'volume_name': 'volume-433d5d54-5c96-44d8-b2d0-550d17dde649', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89498829-c52c-409b-bf38-f0aa4814cb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89498829-c52c-409b-bf38-f0aa4814cb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc69d89-3099-40ae-bee3-e5dcf21ea56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:15 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Volume 433d5d54-5c96-44d8-b2d0-550d17dde649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433d5d54-5c96-44d8-b2d0-550d17dde649', 'volume_size': 1} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:15 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.867s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.83f9f9a3-71a4-4220-b000-4ee6e6955469cob1w805.img {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:34:15 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Converted 1024.00 MB image at 171.71 MB/s Jul 30 16:34:15 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] 83f9f9a3-71a4-4220-b000-4ee6e6955469 was raw, no need to convert to raw {{(pid=88095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 30 16:34:25 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=97,cinder:UPDATE=90,cinder:DELETE=7,cinder:INSERT=27 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:34:25 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=83,cinder:INSERT=22,cinder:SELECT=89,cinder:DELETE=5 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:34:40 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:34:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Flow 'volume_create_manager' (178513e6-a081-42ad-8a4c-32051e908e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8584831-04d8-4c5f-837b-719c3d228a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8584831-04d8-4c5f-837b-719c3d228a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1292406712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c6199e-4979-4304-bf7d-e6ad33d378ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95526221540f4be48245e38b0031de0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:41Z,use_quota=True,user_id='687220d9dbe54932afb847753650b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a66f72-03b6-4c30-a1d8-34e9b6561257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a66f72-03b6-4c30-a1d8-34e9b6561257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca3c1bb-f5a1-4452-8a3e-52975fc56a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca3c1bb-f5a1-4452-8a3e-52975fc56a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c6199e-4979-4304-bf7d-e6ad33d378ac', 'volume_name': 'volume-35c6199e-4979-4304-bf7d-e6ad33d378ac', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fc96b8-bce7-4a63-9650-ce3bed3e98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fc96b8-bce7-4a63-9650-ce3bed3e98eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed599040-28f0-46c1-a8a7-0dd88e12b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Volume 35c6199e-4979-4304-bf7d-e6ad33d378ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c6199e-4979-4304-bf7d-e6ad33d378ac', 'volume_size': 1} Jul 30 16:34:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.051s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Uploaded volume to glance image-id: 83f9f9a3-71a4-4220-b000-4ee6e6955469. {{(pid=88095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.205s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-248206356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433d5d54-5c96-44d8-b2d0-550d17dde649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b13a092134a9e90e69e3a995edb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:15Z,use_quota=True,user_id='0791d74076a246d282c03503472228d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Creating volume 433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:34:45 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:45 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 1073741824 Jul 30 16:34:45 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-dc0bdacf-b734-400c-82af-08d714d173df tempest-VolumesActionsTest-1176375295 None] Copy volume to image completed successfully. Jul 30 16:34:45 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 1073741824" returned: 0 in 0.527s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:45 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 Jul 30 16:34:45 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:46 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649" returned: 0 in 0.320s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.029s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1292406712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c6199e-4979-4304-bf7d-e6ad33d378ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95526221540f4be48245e38b0031de0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:41Z,use_quota=True,user_id='687220d9dbe54932afb847753650b491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Creating volume 35c6199e-4979-4304-bf7d-e6ad33d378ac {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:34:46 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc69d89-3099-40ae-bee3-e5dcf21ea56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433d5d54-5c96-44d8-b2d0-550d17dde649', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:46 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac 1073741824 Jul 30 16:34:46 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714d1987-1247-4127-bb97-05c0df176494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:46 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Volume volume-433d5d54-5c96-44d8-b2d0-550d17dde649 (433d5d54-5c96-44d8-b2d0-550d17dde649): created successfully Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714d1987-1247-4127-bb97-05c0df176494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (bd62eaaa-3561-4cb4-9001-38a55d0c3b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-04f84f45-3eab-4fbe-81a1-da0cb8cc848d tempest-VolumesSnapshotTestJSON-355278868 None] Created volume successfully. Jul 30 16:34:46 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac 1073741824" returned: 0 in 0.691s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:46 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac Jul 30 16:34:46 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:47 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac" returned: 0 in 0.334s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed599040-28f0-46c1-a8a7-0dd88e12b94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c6199e-4979-4304-bf7d-e6ad33d378ac', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b65af9-35e4-4c70-a3be-2a8ebb51ee9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:47 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Volume volume-35c6199e-4979-4304-bf7d-e6ad33d378ac (35c6199e-4979-4304-bf7d-e6ad33d378ac): created successfully Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b65af9-35e4-4c70-a3be-2a8ebb51ee9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Flow 'volume_create_manager' (178513e6-a081-42ad-8a4c-32051e908e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fc23db9f-6dcf-4166-97a4-830bed460b7a tempest-VolumesServicesTestJSON-147446589 None] Created volume successfully. Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:47 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:34:47 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Creating offline snapshot 9ffad8c8-7896-4ca4-9a13-3857a9392d34 of volume 433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33df6b5f-61a5-4c02-8882-6f423297d3df]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:47 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.401s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:34:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:34:47 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 Jul 30 16:34:47 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:48 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649" returned: 0 in 0.433s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:48 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 1G Jul 30 16:34:48 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Acquiring lock "cinder-35c6199e-4979-4304-bf7d-e6ad33d378ac-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Lock "cinder-35c6199e-4979-4304-bf7d-e6ad33d378ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:48 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 1G" returned: 0 in 0.526s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d5d54-5c96-44d8-b2d0-550d17dde649 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:48 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d5d54-5c96-44d8-b2d0-550d17dde649 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Acquiring lock "cinder-quobyte-35c6199e-4979-4304-bf7d-e6ad33d378ac" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:48 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Lock "cinder-quobyte-35c6199e-4979-4304-bf7d-e6ad33d378ac" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7469fea-26a3-4f25-9803-7a82c20f5d2a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:48 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac Jul 30 16:34:48 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:49 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d5d54-5c96-44d8-b2d0-550d17dde649 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34" returned: 0 in 0.360s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:49 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 is being set with open permissions: ugo+rw Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:49 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 Jul 30 16:34:49 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:49 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac" returned: 0 in 0.481s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:49 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac Jul 30 16:34:49 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:49 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34" returned: 0 in 0.282s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:49 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-35c6199e-4979-4304-bf7d-e6ad33d378ac" returned: 0 in 0.296s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Lock "cinder-quobyte-35c6199e-4979-4304-bf7d-e6ad33d378ac" released by "delete_volume" :: held 0.827s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Created reservations ['70fa0ea5-d144-4499-ae66-b5b125ee1b9f', '91803ff8-b343-450d-bbfb-a6bfa871988f', 'f19a584f-6797-4c57-a336-df9a7a474448', 'b119da87-c600-4977-aefe-4fd1ded46050'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:49 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.info Jul 30 16:34:49 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:49 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:34:49 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:50 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.info" returned: 0 in 0.452s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:50 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.info is being set with open permissions: ugo+rw Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:50 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.369s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:50 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.info Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:50 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Deleted volume successfully. Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Flow 'volume_create_manager' (81d0586b-2f0a-4c2f-b923-f487765773cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b27beea-c9b3-4e39-bbcc-31bf16f99513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-308a972d-0e0f-4c1c-b344-f1a0f50ad6b3 tempest-VolumesServicesTestJSON-147446589 None] Lock "cinder-35c6199e-4979-4304-bf7d-e6ad33d378ac-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b27beea-c9b3-4e39-bbcc-31bf16f99513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1423154222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5926e8fe-f104-438c-903a-77e5dc55f51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba6415d2c7a4907b750359bcc66c4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:50Z,use_quota=True,user_id='139e41f4c0a94682804d0069633b2e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f677c6b-0ece-4c1d-8a3b-bd99c5cebeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f677c6b-0ece-4c1d-8a3b-bd99c5cebeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b774ee12-87f9-4a64-bc2d-9deb4bf972fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b774ee12-87f9-4a64-bc2d-9deb4bf972fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5926e8fe-f104-438c-903a-77e5dc55f51a', 'volume_name': 'volume-5926e8fe-f104-438c-903a-77e5dc55f51a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2021b65-9938-4e7f-97f5-aab58f4140e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2021b65-9938-4e7f-97f5-aab58f4140e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640d7c50-6282-4261-85b0-9db459f51cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:50 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Volume 5926e8fe-f104-438c-903a-77e5dc55f51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5926e8fe-f104-438c-903a-77e5dc55f51a', 'volume_size': 1} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:50 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.info" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.704s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.946s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[27747741-3310-48f7-a1cc-178023a5bb41]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2c5f621c-21ea-410c-82d1-76198ec29c9e tempest-VolumesSnapshotTestJSON-355278868 None] Create snapshot completed successfully Jul 30 16:34:50 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:34:50 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:50 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.387s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f22397d-5f74-4561-884a-c20bd57d9d60]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:50 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:34:50 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:51 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.503s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:51 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img Jul 30 16:34:51 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (88814bfa-8e13-4e58-a6dc-8bd7394bcd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c99b74-2924-48f8-9c13-04d4ce5d2e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c99b74-2924-48f8-9c13-04d4ce5d2e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1110677032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb162bf2-3957-4b12-bdec-34b1ab290c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b13a092134a9e90e69e3a995edb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ffad8c8-7896-4ca4-9a13-3857a9392d34,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:51Z,use_quota=True,user_id='0791d74076a246d282c03503472228d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bdb813-d3e3-4507-a9cc-bce465645907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bdb813-d3e3-4507-a9cc-bce465645907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f701ec-74c9-4750-85fe-dbe07560a1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f701ec-74c9-4750-85fe-dbe07560a1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb162bf2-3957-4b12-bdec-34b1ab290c38', 'volume_name': 'volume-fb162bf2-3957-4b12-bdec-34b1ab290c38', 'volume_size': 1, 'snapshot_id': '9ffad8c8-7896-4ca4-9a13-3857a9392d34'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb11bf77-85bc-4af8-b3f3-68da14b9ecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb11bf77-85bc-4af8-b3f3-68da14b9ecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd59916f-cb56-4b11-b628-df48f84601d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Volume fb162bf2-3957-4b12-bdec-34b1ab290c38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb162bf2-3957-4b12-bdec-34b1ab290c38', 'volume_size': 1, 'snapshot_id': '9ffad8c8-7896-4ca4-9a13-3857a9392d34'} Jul 30 16:34:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:56 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img" returned: 0 in 5.177s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f83421c-aed5-4203-8ba1-372c47d1c650]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:56 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:34:56 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:57 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.548s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:34:57 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Converted 1024.00 MB image at 197.78 MB/s Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] 84afaf0f-e4f9-492c-846f-d584cd59f128 was raw, converting to qcow2 {{(pid=88095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a258fe1-03c8-4c24-a983-8bf28503bb28]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:57 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img Jul 30 16:34:57 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:57 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img" returned: 0 in 0.331s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:57 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img Jul 30 16:34:57 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:57 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img" returned: 1 in 0.327s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:34:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img /opt/stack/data/cinder/conversion/vol_upload_mxi1b6aa {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:57 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img /opt/stack/data/cinder/conversion/vol_upload_mxi1b6aa Jul 30 16:34:57 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:58 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img /opt/stack/data/cinder/conversion/vol_upload_mxi1b6aa" returned: 0 in 0.276s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:58 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Image conversion details: src /opt/stack/data/cinder/conversion/24c833e0-6048-42ee-b15c-8f1489df7d12.temp_image.84afaf0f-e4f9-492c-846f-d584cd59f1283u956p8s.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_mxi1b6aa {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:34:58 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 16:34:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5862b351-3b09-48a5-b013-3bb1b681b82d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mxi1b6aa {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:58 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mxi1b6aa Jul 30 16:34:58 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:58 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mxi1b6aa" returned: 0 in 0.360s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.471s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Uploaded volume to glance image-id: 84afaf0f-e4f9-492c-846f-d584cd59f128. {{(pid=88095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.611s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1423154222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5926e8fe-f104-438c-903a-77e5dc55f51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba6415d2c7a4907b750359bcc66c4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:50Z,use_quota=True,user_id='139e41f4c0a94682804d0069633b2e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Creating volume 5926e8fe-f104-438c-903a-77e5dc55f51a {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:34:59 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:34:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:59 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a 1073741824 Jul 30 16:34:59 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cf1b0180-e402-4b48-8bcb-bbc1cbe0d51c tempest-VolumesActionsTest-1176375295 None] Copy volume to image completed successfully. Jul 30 16:35:00 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a 1073741824" returned: 0 in 0.535s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:00 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a Jul 30 16:35:00 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:00 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a" returned: 0 in 0.288s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.104s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-9ffad8c8-7896-4ca4-9a13-3857a9392d34-fb162bf2-3957-4b12-bdec-34b1ab290c38" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640d7c50-6282-4261-85b0-9db459f51cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5926e8fe-f104-438c-903a-77e5dc55f51a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8825f1d-7d41-4742-97bd-eb8a387d130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-9ffad8c8-7896-4ca4-9a13-3857a9392d34-fb162bf2-3957-4b12-bdec-34b1ab290c38" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Creating volume fb162bf2-3957-4b12-bdec-34b1ab290c38 from snapshot 9ffad8c8-7896-4ca4-9a13-3857a9392d34 {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-fb162bf2-3957-4b12-bdec-34b1ab290c38" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Acquiring lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:00 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Volume volume-5926e8fe-f104-438c-903a-77e5dc55f51a (5926e8fe-f104-438c-903a-77e5dc55f51a): created successfully Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8825f1d-7d41-4742-97bd-eb8a387d130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Flow 'volume_create_manager' (81d0586b-2f0a-4c2f-b923-f487765773cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-fb162bf2-3957-4b12-bdec-34b1ab290c38" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] snapshot: 9ffad8c8-7896-4ca4-9a13-3857a9392d34, volume: fb162bf2-3957-4b12-bdec-34b1ab290c38, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9c770ec7-a934-415b-abe9-3bfafd7de138 tempest-ServersNegativeTestJSON-148623114 None] Created volume successfully. Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b5382e-5918-4dfe-9ab0-3d66641ea0b0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Acquiring lock "cinder-quobyte-24c833e0-6048-42ee-b15c-8f1489df7d12" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Lock "cinder-quobyte-24c833e0-6048-42ee-b15c-8f1489df7d12" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba78b6e4-628b-4a87-b3f5-f145b2028809]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:01 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 Jul 30 16:35:01 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:01 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:35:01 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:01 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34" returned: 0 in 0.447s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-433d5d54-5c96-44d8-b2d0-550d17dde649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a74131-9356-4b40-bb6b-db59833b1e7f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:01 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.406s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:01 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12 Jul 30 16:35:01 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:01 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 Jul 30 16:35:01 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:01 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24c833e0-6048-42ee-b15c-8f1489df7d12" returned: 0 in 0.301s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Lock "cinder-quobyte-24c833e0-6048-42ee-b15c-8f1489df7d12" released by "delete_volume" :: held 0.766s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Created reservations ['36e4ecd7-c089-463e-a3a0-fc6adb5ef7f7', 'b71b17ee-e161-4e97-b20f-63468b38dbc9', '323418bd-2383-4a45-89fb-a3ba97c1480e', 'cf669152-d2e4-40fe-9667-f68e208dbd51'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:01 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649" returned: 0 in 0.491s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:01 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 Jul 30 16:35:01 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:02 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:02 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:02 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.358s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:02 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Deleted volume successfully. Jul 30 16:35:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4472a384-7129-4e2a-84e0-67f08ac0fa24 tempest-VolumesActionsTest-1176375295 None] Lock "cinder-24c833e0-6048-42ee-b15c-8f1489df7d12-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:03 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Flow 'volume_create_manager' (09dd3038-8fbf-4249-b3c7-7818d9f4bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06484f91-b2c1-496b-ab0c-0d4738f8f918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06484f91-b2c1-496b-ab0c-0d4738f8f918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1677901970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb5e9ee-9608-403c-987b-6fd517c7d38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba6415d2c7a4907b750359bcc66c4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:04Z,use_quota=True,user_id='139e41f4c0a94682804d0069633b2e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bed6085-18d4-4df9-a34d-3abe5f5c834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bed6085-18d4-4df9-a34d-3abe5f5c834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70102942-16b4-47e1-8e7a-e54fc19a3065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70102942-16b4-47e1-8e7a-e54fc19a3065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb5e9ee-9608-403c-987b-6fd517c7d38f', 'volume_name': 'volume-efb5e9ee-9608-403c-987b-6fd517c7d38f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccd3b0a-25d2-4018-b4ba-f57b7844b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccd3b0a-25d2-4018-b4ba-f57b7844b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52422acb-539d-4db7-8549-74204f32d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:04 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Volume efb5e9ee-9608-403c-987b-6fd517c7d38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb5e9ee-9608-403c-987b-6fd517c7d38f', 'volume_size': 1} Jul 30 16:35:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:07 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38" returned: 0 in 5.674s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:35:07 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Converted 1024.00 MB image at 180.41 MB/s Jul 30 16:35:07 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 is being set with open permissions: ugo+rw Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:07 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 Jul 30 16:35:07 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Flow 'volume_create_manager' (d0b3c6fb-f378-4855-926a-637ddf31c965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:07 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161bf9c2-8964-41f2-a32d-e5f37c6dcea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38" returned: 0 in 0.284s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161bf9c2-8964-41f2-a32d-e5f37c6dcea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-378114695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd78840-ca69-4fbe-9ac6-65fc0c93dabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcf4c1bca1f44aba3812d64ae49eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:08Z,use_quota=True,user_id='a6138d0188f8464c9301145dc3a30f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf08c43-c489-4040-a74a-243551b2324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf08c43-c489-4040-a74a-243551b2324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a9bed7-681b-4cda-a77d-08b128911c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a9bed7-681b-4cda-a77d-08b128911c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd78840-ca69-4fbe-9ac6-65fc0c93dabd', 'volume_name': 'volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180e9cce-e246-451c-b404-35dd3c878663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180e9cce-e246-451c-b404-35dd3c878663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ae1bcd-9d39-42b2-855e-b012b8159422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:07 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Volume 6dd78840-ca69-4fbe-9ac6-65fc0c93dabd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd', 'volume_size': 1} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-fb162bf2-3957-4b12-bdec-34b1ab290c38" released by "_copy_volume_from_snapshot" :: held 7.089s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-9ffad8c8-7896-4ca4-9a13-3857a9392d34-fb162bf2-3957-4b12-bdec-34b1ab290c38" released by "_create_volume_from_snapshot" :: held 7.222s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.266s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.974s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1677901970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb5e9ee-9608-403c-987b-6fd517c7d38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba6415d2c7a4907b750359bcc66c4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:04Z,use_quota=True,user_id='139e41f4c0a94682804d0069633b2e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Creating volume efb5e9ee-9608-403c-987b-6fd517c7d38f {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:08 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:08 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f 1073741824 Jul 30 16:35:08 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd59916f-cb56-4b11-b628-df48f84601d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb162bf2-3957-4b12-bdec-34b1ab290c38', 'volume_size': 1, 'snapshot_id': '9ffad8c8-7896-4ca4-9a13-3857a9392d34'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d770c0-2494-4575-ad87-9978c0826281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:08 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Volume volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 (fb162bf2-3957-4b12-bdec-34b1ab290c38): created successfully Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d770c0-2494-4575-ad87-9978c0826281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Flow 'volume_create_manager' (88814bfa-8e13-4e58-a6dc-8bd7394bcd25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-dedf4892-a4d6-4bac-9fa8-4c15c1365e6b tempest-VolumesSnapshotTestJSON-355278868 None] Created volume successfully. Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-fb162bf2-3957-4b12-bdec-34b1ab290c38-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-fb162bf2-3957-4b12-bdec-34b1ab290c38-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-fb162bf2-3957-4b12-bdec-34b1ab290c38" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-fb162bf2-3957-4b12-bdec-34b1ab290c38" acquired by "delete_volume" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d772371-50bd-4b5b-a2eb-d87c93e6a0c2]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:08 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 Jul 30 16:35:08 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:08 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f 1073741824" returned: 0 in 0.544s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:08 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f Jul 30 16:35:08 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:08 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38" returned: 0 in 0.416s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:08 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38 Jul 30 16:35:08 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:08 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f" returned: 0 in 0.288s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.975s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-378114695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd78840-ca69-4fbe-9ac6-65fc0c93dabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcf4c1bca1f44aba3812d64ae49eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:08Z,use_quota=True,user_id='a6138d0188f8464c9301145dc3a30f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Creating volume 6dd78840-ca69-4fbe-9ac6-65fc0c93dabd {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:08 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52422acb-539d-4db7-8549-74204f32d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb5e9ee-9608-403c-987b-6fd517c7d38f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31503e2d-210b-411a-be08-b5c97375c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:08 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd 1073741824 Jul 30 16:35:08 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:09 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Volume volume-efb5e9ee-9608-403c-987b-6fd517c7d38f (efb5e9ee-9608-403c-987b-6fd517c7d38f): created successfully Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31503e2d-210b-411a-be08-b5c97375c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Flow 'volume_create_manager' (09dd3038-8fbf-4249-b3c7-7818d9f4bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-08466b74-b18f-48b0-a8bd-706df172b22a tempest-ServersNegativeTestJSON-148623114 None] Created volume successfully. Jul 30 16:35:09 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb162bf2-3957-4b12-bdec-34b1ab290c38" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-fb162bf2-3957-4b12-bdec-34b1ab290c38" released by "delete_volume" :: held 0.753s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Created reservations ['90439fc5-32c1-44d4-9809-117134c3edf6', 'fd25810b-c976-4085-ac3e-51b2bd728757', '2c7ce60c-d396-4772-a18c-4c65d1da9a90', '1cea97f9-5e1f-4cfb-8821-8b5fac48673a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:09 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:09 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-9ffad8c8-7896-4ca4-9a13-3857a9392d34-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-9ffad8c8-7896-4ca4-9a13-3857a9392d34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-433d5d54-5c96-44d8-b2d0-550d17dde649" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-433d5d54-5c96-44d8-b2d0-550d17dde649" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-9ffad8c8-7896-4ca4-9a13-3857a9392d34" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:09 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd 1073741824" returned: 0 in 0.703s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-9ffad8c8-7896-4ca4-9a13-3857a9392d34" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Deleting offline snapshot 9ffad8c8-7896-4ca4-9a13-3857a9392d34 of volume 433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] snapshot_file for this snap is: volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabce417-c823-4f4c-b0da-3fbd114eb41c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:09 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.397s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Deleted volume successfully. Jul 30 16:35:09 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd Jul 30 16:35:09 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5009c9d2-28c4-499c-9b7d-24ae6a4b4164 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-fb162bf2-3957-4b12-bdec-34b1ab290c38-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "cinder-efb5e9ee-9608-403c-987b-6fd517c7d38f-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Lock "cinder-efb5e9ee-9608-403c-987b-6fd517c7d38f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:09 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 Jul 30 16:35:09 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "cinder-quobyte-efb5e9ee-9608-403c-987b-6fd517c7d38f" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Lock "cinder-quobyte-efb5e9ee-9608-403c-987b-6fd517c7d38f" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7314a44e-48ed-4cd7-9735-dce95eba2cdd]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:10 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd" returned: 0 in 0.403s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ae1bcd-9d39-42b2-855e-b012b8159422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9278c720-48c3-495c-bb11-d321e8de688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:10 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f Jul 30 16:35:10 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:10 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Volume volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd (6dd78840-ca69-4fbe-9ac6-65fc0c93dabd): created successfully Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9278c720-48c3-495c-bb11-d321e8de688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Flow 'volume_create_manager' (d0b3c6fb-f378-4855-926a-637ddf31c965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bf831376-4a35-4ea2-b3cb-b2f58b62525d tempest-VolumesTransfersTest-1453369024 None] Created volume successfully. Jul 30 16:35:10 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34" returned: 0 in 0.574s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-433d5d54-5c96-44d8-b2d0-550d17dde649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a06a1-d1fe-4b4c-b090-9e38879231df]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:10 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 Jul 30 16:35:10 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:10 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f" returned: 0 in 0.503s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:10 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f Jul 30 16:35:10 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:10 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-efb5e9ee-9608-403c-987b-6fd517c7d38f" returned: 0 in 0.270s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Lock "cinder-quobyte-efb5e9ee-9608-403c-987b-6fd517c7d38f" released by "delete_volume" :: held 0.834s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:10 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649" returned: 0 in 0.576s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:10 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Created reservations ['23de0484-1220-4b9c-a72f-41b13b32e2dd', '6903b348-def7-41bb-9e36-d9d0b4a66f83', 'f1a90da6-6c91-413f-920d-605424a4f36c', '62d492cb-d8d3-4e7c-a697-3c03d89691bd'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:10 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 Jul 30 16:35:10 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:11 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:11 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "cinder-5926e8fe-f104-438c-903a-77e5dc55f51a-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Lock "cinder-5926e8fe-f104-438c-903a-77e5dc55f51a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "cinder-quobyte-5926e8fe-f104-438c-903a-77e5dc55f51a" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Lock "cinder-quobyte-5926e8fe-f104-438c-903a-77e5dc55f51a" acquired by "delete_volume" :: waited 0.031s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[abffeaee-0ba9-4b30-85d4-7c6e2a877002]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:11 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a Jul 30 16:35:11 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:11 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:11 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.524s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34" returned: 0 in 0.671s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Deleted volume successfully. Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba52e5a-a61d-4893-b8b5-807cfaa62e3c tempest-ServersNegativeTestJSON-148623114 None] Lock "cinder-efb5e9ee-9608-403c-987b-6fd517c7d38f-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:11 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34 Jul 30 16:35:11 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:11 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a" returned: 0 in 0.617s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:11 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649.9ffad8c8-7896-4ca4-9a13-3857a9392d34" returned: 0 in 0.419s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:11 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a Jul 30 16:35:11 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-9ffad8c8-7896-4ca4-9a13-3857a9392d34" released by "_delete_snapshot" :: held 2.376s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-433d5d54-5c96-44d8-b2d0-550d17dde649" released by "delete_snapshot" :: held 2.416s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Created reservations ['321d35bf-1682-4484-8ced-8cbe8911650a', '9eac0086-6338-4935-8b61-24500ca87182', '899f353a-29b9-40b7-a4ff-af2fa3012e18', 'b4986d7b-dec1-4327-a45e-24958d4b8f7b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:12 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1e552e3c-09ba-4fc3-9ea5-25d544d4b6c1 tempest-VolumesTransfersTest-1266780900 None] Transfer volume completed successfully. Jul 30 16:35:12 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Delete snapshot completed successfully. Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6dbe019a-767f-461f-86b3-8469f661f412 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-9ffad8c8-7896-4ca4-9a13-3857a9392d34-delete_snapshot" released by "delete_snapshot" :: held 2.694s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:12 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5926e8fe-f104-438c-903a-77e5dc55f51a" returned: 0 in 0.470s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Lock "cinder-quobyte-5926e8fe-f104-438c-903a-77e5dc55f51a" released by "delete_volume" :: held 1.170s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Created reservations ['ec478f6a-ceb6-4266-afa5-e687e860ae2d', '7150356c-ddbd-4c7a-9647-5a6db5c22289', 'd1c1f28a-9ef7-45d4-8456-4343b6edf3f0', '187f542c-bb71-484e-9f25-8747c872a083'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:12 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:12 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Flow 'volume_create_manager' (f4915ebb-9558-4458-a159-47403be28dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0feb50-6f9b-4a67-890a-7fcf243b210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0feb50-6f9b-4a67-890a-7fcf243b210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1670782214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4ac15b-c4a4-4cf3-a616-a2679b49bd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627415450b4a4e3b8423e3d842b71ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:13Z,use_quota=True,user_id='38d8bd792711409abe2b9a81f8f565a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d190b76a-bd13-46eb-ae31-078ef3049520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d190b76a-bd13-46eb-ae31-078ef3049520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9497a0d6-7fd5-410c-a312-f0a03f8a6b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9497a0d6-7fd5-410c-a312-f0a03f8a6b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4ac15b-c4a4-4cf3-a616-a2679b49bd53', 'volume_name': 'volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff90ce67-065c-4c5e-acb4-a30e3f81f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff90ce67-065c-4c5e-acb4-a30e3f81f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd9d5ab-4f42-4e78-a459-e6a1b3e5dfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:12 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Volume de4ac15b-c4a4-4cf3-a616-a2679b49bd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53', 'volume_size': 1} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1670782214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4ac15b-c4a4-4cf3-a616-a2679b49bd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627415450b4a4e3b8423e3d842b71ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:13Z,use_quota=True,user_id='38d8bd792711409abe2b9a81f8f565a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Creating volume de4ac15b-c4a4-4cf3-a616-a2679b49bd53 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:12 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:12 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 1073741824 Jul 30 16:35:12 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-433d5d54-5c96-44d8-b2d0-550d17dde649-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:12 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.327s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-433d5d54-5c96-44d8-b2d0-550d17dde649-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:12 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Deleted volume successfully. Jul 30 16:35:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fd7c6ce6-0f15-4b5d-97e0-9f3a921a15c3 tempest-ServersNegativeTestJSON-148623114 None] Lock "cinder-5926e8fe-f104-438c-903a-77e5dc55f51a-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Acquiring lock "cinder-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-433d5d54-5c96-44d8-b2d0-550d17dde649" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Lock "cinder-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-433d5d54-5c96-44d8-b2d0-550d17dde649" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e4ab18-dd05-4dae-bda1-f865f35fb65f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Acquiring lock "cinder-quobyte-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Lock "cinder-quobyte-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b3f2e5-0597-4347-8403-d6884b1a790b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:13 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 Jul 30 16:35:13 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:13 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd Jul 30 16:35:13 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:13 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 1073741824" returned: 0 in 0.548s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:13 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 Jul 30 16:35:13 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:13 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649" returned: 0 in 0.404s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:13 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649 Jul 30 16:35:13 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:13 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd" returned: 0 in 0.428s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:13 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd Jul 30 16:35:13 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:13 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53" returned: 0 in 0.295s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd9d5ab-4f42-4e78-a459-e6a1b3e5dfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7536c5-94f3-40ed-aac8-c1e7e3f663e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:13 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Volume volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 (de4ac15b-c4a4-4cf3-a616-a2679b49bd53): created successfully Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7536c5-94f3-40ed-aac8-c1e7e3f663e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Flow 'volume_create_manager' (f4915ebb-9558-4458-a159-47403be28dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1d3703cf-0717-4856-bc55-dceef7f1b756 tempest-VolumesNegativeTest-456194965 None] Created volume successfully. Jul 30 16:35:13 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-433d5d54-5c96-44d8-b2d0-550d17dde649" returned: 0 in 0.308s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-433d5d54-5c96-44d8-b2d0-550d17dde649" released by "delete_volume" :: held 0.782s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:13 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Created reservations ['dee32a09-10ae-43d4-9add-961416e42b2b', '695514bc-d7d1-4ec8-ad35-100d5d537fbf', '8de8b18e-9086-46cb-b1b9-8798e2aaf4f7', 'b52d15e2-bbd4-4e3b-8488-93cd5fa2d290'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:14 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd" returned: 0 in 0.414s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Lock "cinder-quobyte-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd" released by "delete_volume" :: held 0.920s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:14 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:14 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Created reservations ['26fd538d-1701-43a8-885f-1198860ff490', 'd09a694f-b3ca-4a44-ab96-a15d9bbc5e5e', '11ab19a8-54d6-4fae-b136-b4b3d434850d', '05a07c4f-983d-4f24-aff8-b255f4d545dc'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:14 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:14 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "cinder-quobyte-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:14 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.362s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Deleted volume successfully. Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8734dd-454c-49e4-953b-88ec05b3370e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e441f561-b5c7-42e3-99b2-0f859d704928 tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-433d5d54-5c96-44d8-b2d0-550d17dde649-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:14 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Deleted volume successfully. Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19e85af8-399b-4bee-98f9-49c57233f8a2 tempest-VolumesTransfersTest-605090648 None] Lock "cinder-6dd78840-ca69-4fbe-9ac6-65fc0c93dabd-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:14 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa Jul 30 16:35:14 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:14 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" returned: 0 in 0.513s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:15 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa Jul 30 16:35:15 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:15 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" returned: 0 in 0.389s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-quobyte-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa" released by "delete_volume" :: held 1.088s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Created reservations ['2344ad5e-554e-41f1-9c8e-eadfdd263b07', '1eff594b-1c59-4431-9622-fb3c0fa5989c', '7fa2b22b-7f4e-4bc6-bbe5-239b246c746d', '790f65d2-a563-4211-b2b9-fbafa3a5ee55'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:15 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:15 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:16 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.393s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:16 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Deleted volume successfully. Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ae753c84-015c-41f3-b351-dc9b01f1d2dd tempest-VolumesSnapshotTestJSON-355278868 None] Lock "cinder-8e18eacc-2cd1-4e4b-a429-eb389eb78ffa-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Flow 'volume_create_manager' (be9debd1-9549-4743-9669-70a869c24c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc5c1c7-5ea0-463a-8e6a-72f12630ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc5c1c7-5ea0-463a-8e6a-72f12630ca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-435186288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4c3ca0-4639-4982-bc23-ab7f526b5af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcf4c1bca1f44aba3812d64ae49eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:16Z,use_quota=True,user_id='a6138d0188f8464c9301145dc3a30f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c2a95-7e90-43c8-a56e-5f2d6f9a45fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698c2a95-7e90-43c8-a56e-5f2d6f9a45fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a846677-cb7c-4516-be98-c118f69a0e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a846677-cb7c-4516-be98-c118f69a0e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4c3ca0-4639-4982-bc23-ab7f526b5af4', 'volume_name': 'volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39235acc-acf5-4807-b3f6-63b0306abba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39235acc-acf5-4807-b3f6-63b0306abba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9527fc-1f62-464f-a112-32d0dadfa88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:16 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Volume 2c4c3ca0-4639-4982-bc23-ab7f526b5af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4', 'volume_size': 1} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-435186288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4c3ca0-4639-4982-bc23-ab7f526b5af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dcf4c1bca1f44aba3812d64ae49eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:16Z,use_quota=True,user_id='a6138d0188f8464c9301145dc3a30f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Creating volume 2c4c3ca0-4639-4982-bc23-ab7f526b5af4 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:16 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:16 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 1073741824 Jul 30 16:35:16 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:16 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 1073741824" returned: 0 in 0.663s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:17 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 Jul 30 16:35:17 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:17 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4" returned: 0 in 0.344s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9527fc-1f62-464f-a112-32d0dadfa88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fe43c6-ae46-4eb8-9642-1192e22090e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:17 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Volume volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 (2c4c3ca0-4639-4982-bc23-ab7f526b5af4): created successfully Jul 30 16:35:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fe43c6-ae46-4eb8-9642-1192e22090e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Flow 'volume_create_manager' (be9debd1-9549-4743-9669-70a869c24c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6529af1f-2207-49f8-b507-30a318b3d21c tempest-VolumesTransfersTest-1453369024 None] Created volume successfully. Jul 30 16:35:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Acquiring lock "cinder-2c4c3ca0-4639-4982-bc23-ab7f526b5af4-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Lock "cinder-2c4c3ca0-4639-4982-bc23-ab7f526b5af4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Acquiring lock "cinder-quobyte-2c4c3ca0-4639-4982-bc23-ab7f526b5af4" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Lock "cinder-quobyte-2c4c3ca0-4639-4982-bc23-ab7f526b5af4" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:18 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e578d-e7c8-48ea-8979-4accf230085b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:18 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 Jul 30 16:35:18 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:19 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4" returned: 0 in 0.393s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:19 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4 Jul 30 16:35:19 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:19 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2c4c3ca0-4639-4982-bc23-ab7f526b5af4" returned: 0 in 0.281s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Lock "cinder-quobyte-2c4c3ca0-4639-4982-bc23-ab7f526b5af4" released by "delete_volume" :: held 0.734s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Created reservations ['a0ac93a1-a7d1-4f32-b496-283546b2cf6d', '3f9e018a-4541-46ef-9e2e-90d3e06b2a0c', '0b44779e-72a9-46ae-b2ed-156d4f859aa7', 'f2ff1957-59aa-4272-bb20-bbbc4c484162'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:19 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:19 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:19 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.304s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:19 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Deleted volume successfully. Jul 30 16:35:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3f3ef0c3-4f4d-4e6c-a481-9db496ad2fce tempest-VolumesTransfersTest-605090648 None] Lock "cinder-2c4c3ca0-4639-4982-bc23-ab7f526b5af4-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:29 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=77,cinder:UPDATE=103,cinder:DELETE=12,cinder:INSERT=21 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:35:29 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=71,cinder:UPDATE=105,cinder:INSERT=28,cinder:DELETE=6 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Flow 'volume_create_manager' (86666b83-09e8-438e-a86b-9a0e2276dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67b1832-dd87-4069-99e8-114ddfcc849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67b1832-dd87-4069-99e8-114ddfcc849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1097773721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cec6b6-d76b-4de6-a494-75e729dc0e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a8ca131c5f4ebb84409bb0d8ee4f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:30Z,use_quota=True,user_id='0eb170fb334749d1a99542f4a1f6b1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9419dede-f8ff-4f70-a4a9-4ba250ca1c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9419dede-f8ff-4f70-a4a9-4ba250ca1c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eab46c1-e999-414f-92a3-b41bb084d591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eab46c1-e999-414f-92a3-b41bb084d591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cec6b6-d76b-4de6-a494-75e729dc0e77', 'volume_name': 'volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77', 'volume_size': 2}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4e3d51-4124-45c1-b4c0-676fcfcff5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4e3d51-4124-45c1-b4c0-676fcfcff5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85ae989-2df2-4355-9bfb-de2a3b8f02be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Volume d4cec6b6-d76b-4de6-a494-75e729dc0e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77', 'volume_size': 2} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1097773721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cec6b6-d76b-4de6-a494-75e729dc0e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a8ca131c5f4ebb84409bb0d8ee4f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:30Z,use_quota=True,user_id='0eb170fb334749d1a99542f4a1f6b1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Creating volume d4cec6b6-d76b-4de6-a494-75e729dc0e77 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:30 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:35:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 2147483648 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:30 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 2147483648 Jul 30 16:35:30 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:31 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 2147483648" returned: 0 in 0.936s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:31 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 Jul 30 16:35:31 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:31 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77" returned: 0 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85ae989-2df2-4355-9bfb-de2a3b8f02be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77', 'volume_size': 2}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58de54c9-5e40-4f7b-8451-6eff3a6cd83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Volume volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 (d4cec6b6-d76b-4de6-a494-75e729dc0e77): created successfully Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58de54c9-5e40-4f7b-8451-6eff3a6cd83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Flow 'volume_create_manager' (86666b83-09e8-438e-a86b-9a0e2276dd52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:31 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-24d1f8d6-ddce-4315-9bd9-9654262752fe tempest-VolumesCloneNegativeTest-224939398 None] Created volume successfully. Jul 30 16:35:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Acquiring lock "cinder-d4cec6b6-d76b-4de6-a494-75e729dc0e77-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Lock "cinder-d4cec6b6-d76b-4de6-a494-75e729dc0e77-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Acquiring lock "cinder-quobyte-d4cec6b6-d76b-4de6-a494-75e729dc0e77" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Lock "cinder-quobyte-d4cec6b6-d76b-4de6-a494-75e729dc0e77" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:32 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a4ed82-3963-416e-8e84-7c6c9f6ee590]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:32 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 Jul 30 16:35:32 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:32 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77" returned: 0 in 0.443s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:32 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77 Jul 30 16:35:32 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:33 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4cec6b6-d76b-4de6-a494-75e729dc0e77" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Lock "cinder-quobyte-d4cec6b6-d76b-4de6-a494-75e729dc0e77" released by "delete_volume" :: held 0.765s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Created reservations ['cb55e5f5-432c-4a00-b83b-ec1a2ef43546', '809cc290-b574-4ab9-8c8a-0110820bb3b3', '3c739b9a-392e-43a2-be0f-e6cadd5e7ab4', 'd16b3e37-5e14-474c-a0f7-7fe59e4919d7'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:33 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:33 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:33 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.390s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Deleted volume successfully. Jul 30 16:35:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1f799e16-7ebe-4cb4-a032-e901ba5fe517 tempest-VolumesCloneNegativeTest-224939398 None] Lock "cinder-d4cec6b6-d76b-4de6-a494-75e729dc0e77-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (82ed0489-f163-4819-819b-32d67b6ec4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a9b294-af06-4c6b-984a-8efc038b6894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a9b294-af06-4c6b-984a-8efc038b6894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-407336676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724e992c-98fa-4381-87d7-27805bd632c6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:39Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a752ffa6-9878-4ac3-9745-1e16ff3d7801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a752ffa6-9878-4ac3-9745-1e16ff3d7801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235e4fc8-8ee5-464c-ba71-1fd60b58a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235e4fc8-8ee5-464c-ba71-1fd60b58a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724e992c-98fa-4381-87d7-27805bd632c6', 'volume_name': 'volume-724e992c-98fa-4381-87d7-27805bd632c6', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d632f66-304d-480e-a0bb-5d71a7ad2158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d632f66-304d-480e-a0bb-5d71a7ad2158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa375178-66af-42a1-a00c-319b77070b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:39 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Volume 724e992c-98fa-4381-87d7-27805bd632c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724e992c-98fa-4381-87d7-27805bd632c6', 'volume_size': 1} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-407336676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724e992c-98fa-4381-87d7-27805bd632c6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:39Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Creating volume 724e992c-98fa-4381-87d7-27805bd632c6 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:39 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:39 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 1073741824 Jul 30 16:35:39 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:39 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 1073741824" returned: 0 in 0.663s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:39 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 Jul 30 16:35:39 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:40 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa375178-66af-42a1-a00c-319b77070b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724e992c-98fa-4381-87d7-27805bd632c6', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e70f0f6-c715-4bfb-ba06-d77142b82a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:40 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Volume volume-724e992c-98fa-4381-87d7-27805bd632c6 (724e992c-98fa-4381-87d7-27805bd632c6): created successfully Jul 30 16:35:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e70f0f6-c715-4bfb-ba06-d77142b82a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (82ed0489-f163-4819-819b-32d67b6ec4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:40 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-88694a05-9662-415e-9023-bc7f59877c25 tempest-VolumesGetTest-1760751822 None] Created volume successfully. Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (4cbf92b6-8bb3-4870-b428-66e7cb84091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a820106-b3a2-4e1f-a687-881e2a1ce627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a820106-b3a2-4e1f-a687-881e2a1ce627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1650458937',display_name='tempest-VolumesGetTest-Volume-1730704672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8137ea5c-abc0-4df9-b7d7-298383059339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:42Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a266842-6cd5-407a-bb5a-f0aae6a1613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a266842-6cd5-407a-bb5a-f0aae6a1613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5135542-c897-4b25-8f02-067cdde780ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5135542-c897-4b25-8f02-067cdde780ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8137ea5c-abc0-4df9-b7d7-298383059339', 'volume_name': 'volume-8137ea5c-abc0-4df9-b7d7-298383059339', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038a96db-b540-4eec-b944-ca7999cccbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038a96db-b540-4eec-b944-ca7999cccbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af573ea0-0351-473f-b79c-8cbf618341a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:42 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Volume 8137ea5c-abc0-4df9-b7d7-298383059339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8137ea5c-abc0-4df9-b7d7-298383059339', 'volume_size': 1} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1650458937',display_name='tempest-VolumesGetTest-Volume-1730704672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8137ea5c-abc0-4df9-b7d7-298383059339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:42Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Creating volume 8137ea5c-abc0-4df9-b7d7-298383059339 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:42 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:42 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 1073741824 Jul 30 16:35:42 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:42 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 1073741824" returned: 0 in 0.659s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:43 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 Jul 30 16:35:43 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:43 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339" returned: 0 in 0.452s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af573ea0-0351-473f-b79c-8cbf618341a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8137ea5c-abc0-4df9-b7d7-298383059339', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a09fe71-c61d-40ff-82e4-e9d79f1d159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:43 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Volume volume-8137ea5c-abc0-4df9-b7d7-298383059339 (8137ea5c-abc0-4df9-b7d7-298383059339): created successfully Jul 30 16:35:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a09fe71-c61d-40ff-82e4-e9d79f1d159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (4cbf92b6-8bb3-4870-b428-66e7cb84091e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9f8e32a0-ac29-47c6-a5b8-0d08f41e3a85 tempest-VolumesGetTest-1760751822 None] Created volume successfully. Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-8137ea5c-abc0-4df9-b7d7-298383059339-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Lock "cinder-8137ea5c-abc0-4df9-b7d7-298383059339-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-8137ea5c-abc0-4df9-b7d7-298383059339" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-8137ea5c-abc0-4df9-b7d7-298383059339" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00241ec1-dc5b-4e63-8ceb-e11bea908888]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Acquiring lock "cinder-de4ac15b-c4a4-4cf3-a616-a2679b49bd53-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Lock "cinder-de4ac15b-c4a4-4cf3-a616-a2679b49bd53-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:44 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 Jul 30 16:35:44 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Acquiring lock "cinder-quobyte-de4ac15b-c4a4-4cf3-a616-a2679b49bd53" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Lock "cinder-quobyte-de4ac15b-c4a4-4cf3-a616-a2679b49bd53" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6022b837-5d53-4182-a68c-c45f8c168181]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:45 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 Jul 30 16:35:45 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:45 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339" returned: 0 in 0.637s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:45 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339 Jul 30 16:35:45 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:45 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53" returned: 0 in 0.516s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:45 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53 Jul 30 16:35:45 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:45 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8137ea5c-abc0-4df9-b7d7-298383059339" returned: 0 in 0.355s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-8137ea5c-abc0-4df9-b7d7-298383059339" released by "delete_volume" :: held 1.057s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Created reservations ['8459d4f1-602f-4cc5-9211-cf00c4366727', '367b3a93-f21c-45a6-811b-b243dc231b79', 'a4bd101a-6dae-4b81-bf8e-d3d9f46e568e', '97492215-15f6-45b3-a704-eb454ba26f20'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:45 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-de4ac15b-c4a4-4cf3-a616-a2679b49bd53" returned: 0 in 0.354s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Lock "cinder-quobyte-de4ac15b-c4a4-4cf3-a616-a2679b49bd53" released by "delete_volume" :: held 0.934s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:45 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:45 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:45 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Created reservations ['3f0014fa-b1a8-43d4-b408-894d3236ab75', '49c8414d-f283-4f57-926b-c8a07627d202', '6f1abec9-535d-4acf-8f63-08b3766b60d7', '8405fa7b-8837-4c77-8a0b-1ef84f848e21'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:46 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:46 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:46 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.409s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Deleted volume successfully. Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1680c173-cea4-45e8-a6b3-52df13c63d8d tempest-VolumesGetTest-1760751822 None] Lock "cinder-8137ea5c-abc0-4df9-b7d7-298383059339-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:46 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.401s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Deleted volume successfully. Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bae2e7c6-265d-465e-b326-54ff9336fbd8 tempest-VolumesNegativeTest-456194965 None] Lock "cinder-de4ac15b-c4a4-4cf3-a616-a2679b49bd53-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-724e992c-98fa-4381-87d7-27805bd632c6-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Lock "cinder-724e992c-98fa-4381-87d7-27805bd632c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-724e992c-98fa-4381-87d7-27805bd632c6" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-724e992c-98fa-4381-87d7-27805bd632c6" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8480fc5-9ce8-43bd-8bf6-239906ba3d32]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:47 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 Jul 30 16:35:47 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:47 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:47 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:47 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6" returned: 0 in 0.488s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:47 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6 Jul 30 16:35:47 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:47 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.317s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:35:47 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-724e992c-98fa-4381-87d7-27805bd632c6" returned: 0 in 0.361s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-724e992c-98fa-4381-87d7-27805bd632c6" released by "delete_volume" :: held 0.910s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:47 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Created reservations ['5758e1e6-5523-437e-baca-49ffb3f22853', 'c5773796-a267-4054-a409-8c8b095f0ff2', '0a11befc-cfb1-4d7e-ba9c-b05d450dc7e1', '47d563da-dae3-4b4b-a0e0-18f394831154'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:48 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:35:48 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:48 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Deleted volume successfully. Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a399e136-dfe7-4635-abd3-47a408023075 tempest-VolumesGetTest-1760751822 None] Lock "cinder-724e992c-98fa-4381-87d7-27805bd632c6-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (f48e3ac3-6e4e-4fd4-bfa5-ab13980188a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488cc7de-fe1c-46f1-a48d-238dd93cd699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488cc7de-fe1c-46f1-a48d-238dd93cd699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-358143857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee209f37-cacb-414f-8c4c-0ab8496ab575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:49Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056610c1-0fc0-4907-9f5a-af0177e8c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056610c1-0fc0-4907-9f5a-af0177e8c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a941822a-4a13-4c0f-b7c7-85252ef687c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a941822a-4a13-4c0f-b7c7-85252ef687c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee209f37-cacb-414f-8c4c-0ab8496ab575', 'volume_name': 'volume-ee209f37-cacb-414f-8c4c-0ab8496ab575', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8244dcdc-9f7a-4be4-859b-a36a0871c2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8244dcdc-9f7a-4be4-859b-a36a0871c2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c4917a-5957-448c-bf6b-bdc593138787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:48 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Volume ee209f37-cacb-414f-8c4c-0ab8496ab575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee209f37-cacb-414f-8c4c-0ab8496ab575', 'volume_size': 1} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-358143857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee209f37-cacb-414f-8c4c-0ab8496ab575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:49Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Creating volume ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:48 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:35:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:49 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 1073741824 Jul 30 16:35:49 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:49 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 1073741824" returned: 0 in 0.566s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:49 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 Jul 30 16:35:49 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:49 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575" returned: 0 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c4917a-5957-448c-bf6b-bdc593138787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee209f37-cacb-414f-8c4c-0ab8496ab575', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae7b83d-303c-45c4-9b15-ab48fd53a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Volume volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 (ee209f37-cacb-414f-8c4c-0ab8496ab575): created successfully Jul 30 16:35:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae7b83d-303c-45c4-9b15-ab48fd53a84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (f48e3ac3-6e4e-4fd4-bfa5-ab13980188a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4a571319-041f-4676-9ffd-8e454af8dd81 tempest-VolumesGetTest-1760751822 None] Created volume successfully. Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (c1e82894-b0e1-4e58-97a9-07dc940d3dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1b9594-f1cc-4adb-840e-704dc5da36b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1b9594-f1cc-4adb-840e-704dc5da36b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-579054277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a97499b-64b5-494a-9ed1-17f32dfc0e74,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ee209f37-cacb-414f-8c4c-0ab8496ab575,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:52Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87387cc-d328-4ea2-80a7-4694f7e774ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87387cc-d328-4ea2-80a7-4694f7e774ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a33d78f-5f2c-451c-af8a-5596e3a26765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a33d78f-5f2c-451c-af8a-5596e3a26765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3a97499b-64b5-494a-9ed1-17f32dfc0e74', 'volume_name': 'volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74', 'volume_size': 1, 'source_volid': 'ee209f37-cacb-414f-8c4c-0ab8496ab575', 'source_volstatus': 'available'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe86090-9445-45a7-9466-b4cc91d9af46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe86090-9445-45a7-9466-b4cc91d9af46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27a2085-ef8a-412d-8cc8-c694911f622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Volume 3a97499b-64b5-494a-9ed1-17f32dfc0e74: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74', 'volume_size': 1, 'source_volid': 'ee209f37-cacb-414f-8c4c-0ab8496ab575', 'source_volstatus': 'available'} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:51 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Cloning volume ee209f37-cacb-414f-8c4c-0ab8496ab575 to volume 3a97499b-64b5-494a-9ed1-17f32dfc0e74 Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Creating offline snapshot b132434e-bc59-4e32-acfe-688cf5ae969b of volume ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc8abc-f0e3-45a3-b9b9-03f0eed06216]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:52 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 Jul 30 16:35:52 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:52 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575" returned: 0 in 0.526s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:52 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b 1G Jul 30 16:35:52 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:53 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b 1G" returned: 0 in 0.503s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:53 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b Jul 30 16:35:53 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:53 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b" returned: 0 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:53 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b is being set with open permissions: ugo+rw Jul 30 16:35:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:53 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b Jul 30 16:35:53 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:53 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b" returned: 0 in 0.279s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:53 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.info Jul 30 16:35:53 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:53 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.info" returned: 0 in 0.325s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:54 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.info is being set with open permissions: ugo+rw Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:54 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.info Jul 30 16:35:54 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:54 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.info" returned: 0 in 0.300s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-3a97499b-64b5-494a-9ed1-17f32dfc0e74" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-3a97499b-64b5-494a-9ed1-17f32dfc0e74" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] snapshot: b132434e-bc59-4e32-acfe-688cf5ae969b, volume: 3a97499b-64b5-494a-9ed1-17f32dfc0e74, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe4a658-32d5-454c-90d6-fab8630d6098]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:54 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b Jul 30 16:35:54 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:54 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b" returned: 0 in 0.435s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee209f37-cacb-414f-8c4c-0ab8496ab575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bd89bb-4a5a-427c-bb40-176528b3dd4d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:55 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 Jul 30 16:35:55 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:55 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575" returned: 0 in 0.470s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:35:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:35:55 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:35:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:55 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 Jul 30 16:35:55 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:01 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74" returned: 0 in 6.146s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:01 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:36:01 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Converted 1024.00 MB image at 166.58 MB/s Jul 30 16:36:01 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 is being set with open permissions: ugo+rw Jul 30 16:36:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:01 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 Jul 30 16:36:01 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:01 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74" returned: 0 in 0.382s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-3a97499b-64b5-494a-9ed1-17f32dfc0e74" released by "_copy_volume_from_snapshot" :: held 7.581s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-b132434e-bc59-4e32-acfe-688cf5ae969b" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-b132434e-bc59-4e32-acfe-688cf5ae969b" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Deleting offline snapshot b132434e-bc59-4e32-acfe-688cf5ae969b of volume ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] snapshot_file for this snap is: volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8f8878-a08f-4aa0-ae60-391d50dbb5f5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:02 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b Jul 30 16:36:02 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:02 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b" returned: 0 in 0.509s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee209f37-cacb-414f-8c4c-0ab8496ab575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[984cc7e3-8670-4ede-b2fe-d9e68e6dc804]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:02 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 Jul 30 16:36:02 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:03 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575" returned: 0 in 0.609s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:03 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b Jul 30 16:36:03 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:03 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=32,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=4 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:36:03 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b" returned: 0 in 0.437s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:03 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b Jul 30 16:36:03 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:04 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575.b132434e-bc59-4e32-acfe-688cf5ae969b" returned: 0 in 0.294s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-b132434e-bc59-4e32-acfe-688cf5ae969b" released by "_delete_snapshot" :: held 2.045s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.205s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27a2085-ef8a-412d-8cc8-c694911f622c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74', 'volume_size': 1, 'source_volid': 'ee209f37-cacb-414f-8c4c-0ab8496ab575', 'source_volstatus': 'available'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45e407f-1602-4977-b181-ffffbc25657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:04 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Volume volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 (3a97499b-64b5-494a-9ed1-17f32dfc0e74): created successfully Jul 30 16:36:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45e407f-1602-4977-b181-ffffbc25657e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (c1e82894-b0e1-4e58-97a9-07dc940d3dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f3518818-2ffb-45e0-8b58-4694a0ad600f tempest-VolumesGetTest-1760751822 None] Created volume successfully. Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Flow 'volume_create_manager' (f33d0ac2-aae5-4ebb-84d9-7efd2c39f657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fcfb31-f03d-4a9f-b84c-b9c22ba659f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fcfb31-f03d-4a9f-b84c-b9c22ba659f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-945793111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07682602-f729-4e74-bf68-a26e0697a77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322b5199c6c849b089a7c76b8ca1e87e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:05Z,use_quota=True,user_id='84ded5636a564a80be8a272907f9ce9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188f1136-f6fe-4df8-b720-7fa8cc7799dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188f1136-f6fe-4df8-b720-7fa8cc7799dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62a99f4-f3ba-4893-a2f6-809ededc9477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62a99f4-f3ba-4893-a2f6-809ededc9477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07682602-f729-4e74-bf68-a26e0697a77a', 'volume_name': 'volume-07682602-f729-4e74-bf68-a26e0697a77a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ff1161-eed8-4955-bf51-0f2474ca5d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ff1161-eed8-4955-bf51-0f2474ca5d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfceb9f6-6a0d-4448-85fc-7ab6b42d305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:05 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Volume 07682602-f729-4e74-bf68-a26e0697a77a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07682602-f729-4e74-bf68-a26e0697a77a', 'volume_size': 1} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-945793111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07682602-f729-4e74-bf68-a26e0697a77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322b5199c6c849b089a7c76b8ca1e87e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:05Z,use_quota=True,user_id='84ded5636a564a80be8a272907f9ce9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Creating volume 07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:05 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:05 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a 1073741824 Jul 30 16:36:05 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:06 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a 1073741824" returned: 0 in 0.801s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:06 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a Jul 30 16:36:06 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (08c4fe4c-c161-431a-9906-78cdb79fdcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6a7816-2baf-4758-b5fb-d5c570bd167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6a7816-2baf-4758-b5fb-d5c570bd167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1066863019',display_name='tempest-VolumesGetTest-Volume-775447274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75959c00-ddad-4e7c-9053-8d3e908e4dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:07Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d78fefe-2ad9-4bb3-a670-0d5bf6a6e810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d78fefe-2ad9-4bb3-a670-0d5bf6a6e810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32b4d70-9956-4c84-aa60-107261167429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32b4d70-9956-4c84-aa60-107261167429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75959c00-ddad-4e7c-9053-8d3e908e4dc3', 'volume_name': 'volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf719242-0c89-40a1-8bd2-5f23079dd3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf719242-0c89-40a1-8bd2-5f23079dd3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9192bafd-96d6-4e61-af5c-32c797cf61f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Volume 75959c00-ddad-4e7c-9053-8d3e908e4dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3', 'volume_size': 1} Jul 30 16:36:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:07 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a" returned: 0 in 0.422s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1066863019',display_name='tempest-VolumesGetTest-Volume-775447274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75959c00-ddad-4e7c-9053-8d3e908e4dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:07Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Creating volume 75959c00-ddad-4e7c-9053-8d3e908e4dc3 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:07 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfceb9f6-6a0d-4448-85fc-7ab6b42d305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07682602-f729-4e74-bf68-a26e0697a77a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445272b3-f981-45b8-80c1-9126c1bc64ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:07 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 1073741824 Jul 30 16:36:07 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:07 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Volume volume-07682602-f729-4e74-bf68-a26e0697a77a (07682602-f729-4e74-bf68-a26e0697a77a): created successfully Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445272b3-f981-45b8-80c1-9126c1bc64ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Flow 'volume_create_manager' (f33d0ac2-aae5-4ebb-84d9-7efd2c39f657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a623d95f-4e9e-4c34-8797-1ed3dddc40a3 tempest-TestStampPattern-1018346385 None] Created volume successfully. Jul 30 16:36:07 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 1073741824" returned: 0 in 0.831s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:07 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 Jul 30 16:36:07 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:08 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3" returned: 0 in 0.456s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9192bafd-96d6-4e61-af5c-32c797cf61f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea37cfb4-a940-47f0-b9bf-7ff8161aafc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:08 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Volume volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 (75959c00-ddad-4e7c-9053-8d3e908e4dc3): created successfully Jul 30 16:36:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea37cfb4-a940-47f0-b9bf-7ff8161aafc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (08c4fe4c-c161-431a-9906-78cdb79fdcc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-344dc6a7-3566-47f5-8cbe-0c650935b3ed tempest-VolumesGetTest-1760751822 None] Created volume successfully. Jul 30 16:36:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-75959c00-ddad-4e7c-9053-8d3e908e4dc3-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Lock "cinder-75959c00-ddad-4e7c-9053-8d3e908e4dc3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-75959c00-ddad-4e7c-9053-8d3e908e4dc3" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-75959c00-ddad-4e7c-9053-8d3e908e4dc3" acquired by "delete_volume" :: waited 0.044s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5abeca-3eb6-4be3-8395-3c2d4eb57d6d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:09 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 Jul 30 16:36:09 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:10 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3" returned: 0 in 0.721s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:10 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3 Jul 30 16:36:10 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:10 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75959c00-ddad-4e7c-9053-8d3e908e4dc3" returned: 0 in 0.462s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-75959c00-ddad-4e7c-9053-8d3e908e4dc3" released by "delete_volume" :: held 1.262s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Created reservations ['86b80e32-3412-4dca-83fc-eb1e33c45ad7', 'dd4d9c55-f3ba-4eb9-9bd4-d9d857a07ea2', 'd368addb-a350-453e-841f-1732ef0852a3', '0fafe498-3cb7-49f3-930c-c6a90725fa4f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:10 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:36:10 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:11 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.478s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Deleted volume successfully. Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9a09b3d6-c655-4c07-9667-c9af4080f83e tempest-VolumesGetTest-1760751822 None] Lock "cinder-75959c00-ddad-4e7c-9053-8d3e908e4dc3-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-3a97499b-64b5-494a-9ed1-17f32dfc0e74-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Lock "cinder-3a97499b-64b5-494a-9ed1-17f32dfc0e74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-3a97499b-64b5-494a-9ed1-17f32dfc0e74" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-3a97499b-64b5-494a-9ed1-17f32dfc0e74" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d61db-6afe-49e8-8c11-1b27b1f0df58]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:12 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 Jul 30 16:36:12 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:12 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74" returned: 0 in 0.663s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:12 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74 Jul 30 16:36:12 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:13 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97499b-64b5-494a-9ed1-17f32dfc0e74" returned: 0 in 0.602s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-3a97499b-64b5-494a-9ed1-17f32dfc0e74" released by "delete_volume" :: held 1.333s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Created reservations ['25002381-a98b-416a-a81d-090c875d71bf', 'edf4bb44-31ab-4226-979f-a3ca88f9c401', '0883cf8b-72d6-410b-89fe-f44978fcb5cd', '96c6014b-ca3b-456f-a208-79ee021411bf'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:13 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:36:13 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:13 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Deleted volume successfully. Jul 30 16:36:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56985898-26b8-410d-a88d-cdd1cb8129e8 tempest-VolumesGetTest-1760751822 None] Lock "cinder-3a97499b-64b5-494a-9ed1-17f32dfc0e74-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-ee209f37-cacb-414f-8c4c-0ab8496ab575-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Lock "cinder-ee209f37-cacb-414f-8c4c-0ab8496ab575-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-ee209f37-cacb-414f-8c4c-0ab8496ab575" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-ee209f37-cacb-414f-8c4c-0ab8496ab575" acquired by "delete_volume" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:14 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df49bfc-d8ea-4001-aa7b-c04259ad799f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:14 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 Jul 30 16:36:14 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:15 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575" returned: 0 in 0.584s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:15 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575 Jul 30 16:36:15 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:15 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ee209f37-cacb-414f-8c4c-0ab8496ab575" returned: 0 in 0.411s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-ee209f37-cacb-414f-8c4c-0ab8496ab575" released by "delete_volume" :: held 1.112s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Created reservations ['f9e7491b-9eae-4571-8bbc-9b3b6656c94f', '4fc8c375-86ab-4ee2-b77a-b9a5dd34d7ca', 'eb5138d1-696b-404e-8877-e5f28953699c', '762ac46b-70ea-4b97-9943-907f2a664e79'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:15 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:36:15 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:16 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.433s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:16 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:16 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Deleted volume successfully. Jul 30 16:36:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-04b6892b-e3be-4cc7-8c7a-0205c47f2da7 tempest-VolumesGetTest-1760751822 None] Lock "cinder-ee209f37-cacb-414f-8c4c-0ab8496ab575-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:18 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (8fa42c77-bf19-4e2c-89de-1923be96f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9942c3f7-d767-4098-ac7c-458bdd4ab05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9942c3f7-d767-4098-ac7c-458bdd4ab05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1949601616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3041764-577e-4bf7-a7df-46ec733a89e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:19Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f9687c-63fd-466a-905b-4a732ef946d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f9687c-63fd-466a-905b-4a732ef946d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:18 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea10962-d670-4e67-9b59-c49078e7e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:18 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:36:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea10962-d670-4e67-9b59-c49078e7e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3041764-577e-4bf7-a7df-46ec733a89e5', 'volume_name': 'volume-d3041764-577e-4bf7-a7df-46ec733a89e5', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc4290d-dc78-4b6b-858e-b198f2e71dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc4290d-dc78-4b6b-858e-b198f2e71dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:19 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83ceda2-f151-4473-b641-6520653f8e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:19 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Volume d3041764-577e-4bf7-a7df-46ec733a89e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3041764-577e-4bf7-a7df-46ec733a89e5', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:36:19 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Trying to clone d3041764-577e-4bf7-a7df-46ec733a89e5 from image ea19a761-954a-4f28-b989-b2705e0735e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:36:19 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:36:19 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:36:20 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc20c851-76d5-4c9a-818d-6c1b9fa261a5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:20 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD Jul 30 16:36:20 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:20 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:20 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Temporary image ea19a761-954a-4f28-b989-b2705e0735e6 is fetched for user b3c5b67b54e04540a35814744728e4e6. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:36:20 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[360cfa18-cb7b-4d10-8f3f-04a9e44a9906]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:21 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD Jul 30 16:36:21 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:21 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1949601616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3041764-577e-4bf7-a7df-46ec733a89e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:19Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Creating volume d3041764-577e-4bf7-a7df-46ec733a89e5 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:21 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:21 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 1073741824 Jul 30 16:36:21 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:21 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 1073741824" returned: 0 in 0.561s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:22 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 Jul 30 16:36:22 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:22 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:22 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Attempting download of ea19a761-954a-4f28-b989-b2705e0735e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}])) to volume d3041764-577e-4bf7-a7df-46ec733a89e5. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:36:22 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[32981086-10b8-4835-acb6-b97bd5de35e9]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_rmv6jkau {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:22 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_rmv6jkau Jul 30 16:36:22 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:23 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_rmv6jkau" returned: 0 in 0.589s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_rmv6jkau {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:23 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_rmv6jkau Jul 30 16:36:23 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:23 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_rmv6jkau" returned: 1 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_rmv6jkau' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[880f911c-bca5-4b3e-861d-5aa5a3efa676]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:23 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD Jul 30 16:36:23 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:23 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] ea19a761-954a-4f28-b989-b2705e0735e6 was qcow2, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:36:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:23 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 Jul 30 16:36:23 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:26 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5" returned: 0 in 2.637s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:26 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_8vtl_4medevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:36:26 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Converted 112.00 MB image at 42.45 MB/s Jul 30 16:36:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:26 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 1G Jul 30 16:36:26 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:26 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 1G" returned: 0 in 0.431s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:26 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Downloaded image ea19a761-954a-4f28-b989-b2705e0735e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}])) to volume d3041764-577e-4bf7-a7df-46ec733a89e5 successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:36:26 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Temporary image ea19a761-954a-4f28-b989-b2705e0735e6 for user b3c5b67b54e04540a35814744728e4e6 is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:36:26 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Marking volume d3041764-577e-4bf7-a7df-46ec733a89e5 as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:36:26 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Copying metadata from image ea19a761-954a-4f28-b989-b2705e0735e6 to d3041764-577e-4bf7-a7df-46ec733a89e5. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:36:27 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Creating volume glance metadata for volume d3041764-577e-4bf7-a7df-46ec733a89e5 backed by image ea19a761-954a-4f28-b989-b2705e0735e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:36:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83ceda2-f151-4473-b641-6520653f8e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3041764-577e-4bf7-a7df-46ec733a89e5', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0843939e-32a1-426e-8c7c-ec7c1665822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:27 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Volume volume-d3041764-577e-4bf7-a7df-46ec733a89e5 (d3041764-577e-4bf7-a7df-46ec733a89e5): created successfully Jul 30 16:36:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0843939e-32a1-426e-8c7c-ec7c1665822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (8fa42c77-bf19-4e2c-89de-1923be96f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2a4ee262-7ed4-4b86-9f6c-b5c85b2fc967 tempest-VolumesGetTest-1760751822 None] Created volume successfully. Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (d7d8dfa9-c933-4d9e-9443-eeed8c22a606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e10cef-498b-432b-a875-80b3326aa481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e10cef-498b-432b-a875-80b3326aa481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-278696522',display_name='tempest-VolumesGetTest-Volume-1992623956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366625db-40d2-4f15-9000-edc4ae7f874b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:28Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6e0592-8baf-44e7-bd91-c6cbb92c36d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6e0592-8baf-44e7-bd91-c6cbb92c36d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca80e21-c9c3-4751-b640-15e28fdba911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca80e21-c9c3-4751-b640-15e28fdba911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '366625db-40d2-4f15-9000-edc4ae7f874b', 'volume_name': 'volume-366625db-40d2-4f15-9000-edc4ae7f874b', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752e4a53-84d5-42af-9d99-732ac30a5df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752e4a53-84d5-42af-9d99-732ac30a5df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d87ed81-1cf1-47b9-9d21-168a5e75f627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Volume 366625db-40d2-4f15-9000-edc4ae7f874b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-366625db-40d2-4f15-9000-edc4ae7f874b', 'volume_size': 1} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-278696522',display_name='tempest-VolumesGetTest-Volume-1992623956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366625db-40d2-4f15-9000-edc4ae7f874b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a43c3c668841ef98173c1d30fa018b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:28Z,use_quota=True,user_id='b3c5b67b54e04540a35814744728e4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Creating volume 366625db-40d2-4f15-9000-edc4ae7f874b {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:28 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:28 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b 1073741824 Jul 30 16:36:28 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:29 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b 1073741824" returned: 0 in 0.912s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:29 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b Jul 30 16:36:29 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:29 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b" returned: 0 in 0.411s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d87ed81-1cf1-47b9-9d21-168a5e75f627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366625db-40d2-4f15-9000-edc4ae7f874b', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31c29ec-f83a-45c1-bef3-8be68e717151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=85,cinder:SELECT=65,cinder:INSERT=25,cinder:DELETE=8 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:36:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Volume volume-366625db-40d2-4f15-9000-edc4ae7f874b (366625db-40d2-4f15-9000-edc4ae7f874b): created successfully Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31c29ec-f83a-45c1-bef3-8be68e717151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Flow 'volume_create_manager' (d7d8dfa9-c933-4d9e-9443-eeed8c22a606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a55fc9bb-8c15-4bce-a7b0-54359b931ae2 tempest-VolumesGetTest-1760751822 None] Created volume successfully. Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-366625db-40d2-4f15-9000-edc4ae7f874b-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Lock "cinder-366625db-40d2-4f15-9000-edc4ae7f874b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-366625db-40d2-4f15-9000-edc4ae7f874b" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-366625db-40d2-4f15-9000-edc4ae7f874b" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1400687-2221-4fdc-9869-6490d2e0c3af]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:30 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b Jul 30 16:36:30 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:31 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b" returned: 0 in 0.489s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:31 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b Jul 30 16:36:31 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:32 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Flow 'volume_create_manager' (b137adbb-3bea-4140-bf62-cee8f6d50842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc2c946-e0e7-422e-8d48-ce5e6ca1e2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-366625db-40d2-4f15-9000-edc4ae7f874b" returned: 0 in 0.764s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-366625db-40d2-4f15-9000-edc4ae7f874b" released by "delete_volume" :: held 1.308s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc2c946-e0e7-422e-8d48-ce5e6ca1e2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-943201937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e336c2c-5d3a-4b69-988c-3ea0b8eaca13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b14a299505f41398640a9cd14f60dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:32Z,use_quota=True,user_id='7b95305b5c7e4cf5ac191ae6b24411c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8545741-e905-46aa-bb12-ce781403353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8545741-e905-46aa-bb12-ce781403353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bba8c31-cdd9-42c8-bc5a-e411da98ab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bba8c31-cdd9-42c8-bc5a-e411da98ab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e336c2c-5d3a-4b69-988c-3ea0b8eaca13', 'volume_name': 'volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265ca55b-556a-4ac2-8702-4d220fecee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265ca55b-556a-4ac2-8702-4d220fecee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42a33f7-4ed9-4cfb-aea3-2d3b377552de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:32 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Volume 3e336c2c-5d3a-4b69-988c-3ea0b8eaca13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13', 'volume_size': 1} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-943201937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e336c2c-5d3a-4b69-988c-3ea0b8eaca13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b14a299505f41398640a9cd14f60dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:32Z,use_quota=True,user_id='7b95305b5c7e4cf5ac191ae6b24411c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Creating volume 3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:32 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:32 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 1073741824 Jul 30 16:36:32 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Created reservations ['7e5122a5-02a4-4c77-afa9-84ba414a3a80', '5a2c58eb-d7f3-4461-852f-cfe530316a3b', 'd523c6e8-74d9-4684-b263-fdb78a0e4a2a', '121accc7-6855-42c6-b44c-c66200c055e3'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:32 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:36:32 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:32 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.391s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Deleted volume successfully. Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f9c90aff-0349-4890-b235-39d1eb5bc951 tempest-VolumesGetTest-1760751822 None] Lock "cinder-366625db-40d2-4f15-9000-edc4ae7f874b-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:32 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 1073741824" returned: 0 in 0.664s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:32 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 Jul 30 16:36:32 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-d3041764-577e-4bf7-a7df-46ec733a89e5-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Lock "cinder-d3041764-577e-4bf7-a7df-46ec733a89e5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Acquiring lock "cinder-quobyte-d3041764-577e-4bf7-a7df-46ec733a89e5" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:33 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13" returned: 0 in 0.361s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-d3041764-577e-4bf7-a7df-46ec733a89e5" acquired by "delete_volume" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42a33f7-4ed9-4cfb-aea3-2d3b377552de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8585d6df-7d0b-4a4a-b984-b63831736c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2441e292-9e8c-485d-8aa4-f6cc88d4d1ca]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:33 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Volume volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 (3e336c2c-5d3a-4b69-988c-3ea0b8eaca13): created successfully Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8585d6df-7d0b-4a4a-b984-b63831736c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Flow 'volume_create_manager' (b137adbb-3bea-4140-bf62-cee8f6d50842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-165b5d68-bbbd-4879-884a-77458b898e13 tempest-AttachVolumeShelveTestJSON-1314642646 None] Created volume successfully. Jul 30 16:36:33 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 Jul 30 16:36:33 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:33 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5" returned: 0 in 0.375s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:33 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5 Jul 30 16:36:33 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:33 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d3041764-577e-4bf7-a7df-46ec733a89e5" returned: 0 in 0.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Lock "cinder-quobyte-d3041764-577e-4bf7-a7df-46ec733a89e5" released by "delete_volume" :: held 0.680s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:33 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Created reservations ['6ecad76f-5b97-4ffa-8db4-860ea7ba3a18', 'b823e273-d7a7-4717-a604-3619d22e27a6', '4cc5071b-1a0d-4d4a-8ed0-58e5f0ff6c08', '1ccf151b-4573-4e2b-a8c4-e071671a4199'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:34 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:36:34 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:34 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.289s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:34 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Deleted volume successfully. Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5deaf3ca-a83a-43e1-a7b0-c0b9e9d8a999 tempest-VolumesGetTest-1760751822 None] Lock "cinder-d3041764-577e-4bf7-a7df-46ec733a89e5-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Flow 'volume_create_manager' (186ac471-144b-4bce-bca2-bc524d0bf6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e353b1df-0981-463c-9543-f5b277a32640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e353b1df-0981-463c-9543-f5b277a32640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1762509741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0f038b-e066-4b55-96d8-ee44f933c611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b742a58b78af49b19739808c6f8918ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:35Z,use_quota=True,user_id='6831fd69bfe846fe9d84c4b6fd3ac80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6415107-0b46-448d-8432-f6a1ae58d21a),volume_type_id=f6415107-0b46-448d-8432-f6a1ae58d21a)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a63dc33-8488-41da-b1b4-248513e012ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a63dc33-8488-41da-b1b4-248513e012ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1274658-742e-4439-9b04-8b9e7d93fad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1274658-742e-4439-9b04-8b9e7d93fad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f0f038b-e066-4b55-96d8-ee44f933c611', 'volume_name': 'volume-7f0f038b-e066-4b55-96d8-ee44f933c611', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c312c835-4494-4726-8645-b4882c8c39f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c312c835-4494-4726-8645-b4882c8c39f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72b68d7-6382-46e0-b981-11dbdd0e8094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume 7f0f038b-e066-4b55-96d8-ee44f933c611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f0f038b-e066-4b55-96d8-ee44f933c611', 'volume_size': 1} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1762509741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f0f038b-e066-4b55-96d8-ee44f933c611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b742a58b78af49b19739808c6f8918ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:35Z,use_quota=True,user_id='6831fd69bfe846fe9d84c4b6fd3ac80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6415107-0b46-448d-8432-f6a1ae58d21a),volume_type_id=f6415107-0b46-448d-8432-f6a1ae58d21a)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Creating volume 7f0f038b-e066-4b55-96d8-ee44f933c611 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:35 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:35 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 1073741824 Jul 30 16:36:35 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Flow 'volume_create_manager' (dd824cba-cc3f-4501-9146-7ced50a7e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89d3d90-e060-496a-97cd-db901f0594d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89d3d90-e060-496a-97cd-db901f0594d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-121739031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6088719-11ca-464e-8ad7-289b2dcd1809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b742a58b78af49b19739808c6f8918ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:36Z,use_quota=True,user_id='6831fd69bfe846fe9d84c4b6fd3ac80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2897da10-5d8c-4351-8d8b-89b704cb9598),volume_type_id=2897da10-5d8c-4351-8d8b-89b704cb9598)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd08358-4ddd-4ffe-90ab-d04f36550c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd08358-4ddd-4ffe-90ab-d04f36550c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b8c114-c8dc-4959-af6b-567ad2380311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b8c114-c8dc-4959-af6b-567ad2380311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6088719-11ca-464e-8ad7-289b2dcd1809', 'volume_name': 'volume-e6088719-11ca-464e-8ad7-289b2dcd1809', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa17d64-95f1-487a-91ec-05cff06d836f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa17d64-95f1-487a-91ec-05cff06d836f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af48f4ab-2a0d-422b-8df4-c4c5f4944ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume e6088719-11ca-464e-8ad7-289b2dcd1809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6088719-11ca-464e-8ad7-289b2dcd1809', 'volume_size': 1} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:35 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 1073741824" returned: 0 in 0.766s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:35 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 Jul 30 16:36:35 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Flow 'volume_create_manager' (71fecf2c-5eac-4464-bcb1-867929f73087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2469a3-5818-458a-9285-e4c826e957a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2469a3-5818-458a-9285-e4c826e957a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-93297693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ae134a-da48-4b76-a135-a9e53c58355f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b742a58b78af49b19739808c6f8918ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:36Z,use_quota=True,user_id='6831fd69bfe846fe9d84c4b6fd3ac80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d725e20f-a979-4365-b7be-315f8308f1ca),volume_type_id=d725e20f-a979-4365-b7be-315f8308f1ca)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd1f379-5955-408d-872f-04bbb64e970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd1f379-5955-408d-872f-04bbb64e970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57365705-6a91-4119-ad0c-20099c99e8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:36:36 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611" returned: 0 in 0.383s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-121739031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6088719-11ca-464e-8ad7-289b2dcd1809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b742a58b78af49b19739808c6f8918ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:36Z,use_quota=True,user_id='6831fd69bfe846fe9d84c4b6fd3ac80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2897da10-5d8c-4351-8d8b-89b704cb9598),volume_type_id=2897da10-5d8c-4351-8d8b-89b704cb9598)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Creating volume e6088719-11ca-464e-8ad7-289b2dcd1809 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:36 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:36 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 1073741824 Jul 30 16:36:36 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72b68d7-6382-46e0-b981-11dbdd0e8094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f0f038b-e066-4b55-96d8-ee44f933c611', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839020c6-5a97-44c3-b412-758a882d9a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:36 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume volume-7f0f038b-e066-4b55-96d8-ee44f933c611 (7f0f038b-e066-4b55-96d8-ee44f933c611): created successfully Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839020c6-5a97-44c3-b412-758a882d9a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Flow 'volume_create_manager' (186ac471-144b-4bce-bca2-bc524d0bf6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f4e31cc3-ef43-45b3-af75-5eab0818a5d7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Created volume successfully. Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57365705-6a91-4119-ad0c-20099c99e8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38ae134a-da48-4b76-a135-a9e53c58355f', 'volume_name': 'volume-38ae134a-da48-4b76-a135-a9e53c58355f', 'volume_size': 1, 'image_id': 'b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1459330726', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b742a58b78af49b19739808c6f8918ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'created_at': datetime.datetime(2026, 7, 30, 14, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 36, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c/file', 'properties': {}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea164c5-eb68-4fa2-a669-5231e57d691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea164c5-eb68-4fa2-a669-5231e57d691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a1cb8b-4365-4cd1-9b37-f32e2d9d9e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:36 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume 38ae134a-da48-4b76-a135-a9e53c58355f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38ae134a-da48-4b76-a135-a9e53c58355f', 'volume_size': 1, 'image_id': 'b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1459330726', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b742a58b78af49b19739808c6f8918ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'created_at': datetime.datetime(2026, 7, 30, 14, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 36, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c/file', 'properties': {}}, 'image_service': } Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Trying to clone 38ae134a-da48-4b76-a135-a9e53c58355f from image b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:36:36 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 1073741824" returned: 0 in 0.614s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:37 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 Jul 30 16:36:37 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:37 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809" returned: 0 in 0.371s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af48f4ab-2a0d-422b-8df4-c4c5f4944ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6088719-11ca-464e-8ad7-289b2dcd1809', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2e9b79-34a8-4ba2-ab9a-ee463497d930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:37 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume volume-e6088719-11ca-464e-8ad7-289b2dcd1809 (e6088719-11ca-464e-8ad7-289b2dcd1809): created successfully Jul 30 16:36:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2e9b79-34a8-4ba2-ab9a-ee463497d930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Flow 'volume_create_manager' (dd824cba-cc3f-4501-9146-7ced50a7e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8990c545-fd64-439c-adc6-6aa871653643 tempest-TestInstancesWithCinderVolumes-1165442800 None] Created volume successfully. Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Flow 'volume_create_manager' (17955d62-c0d1-42d6-b80b-9d94785c1c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8682507-f6f1-4a84-97ae-71986002b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8682507-f6f1-4a84-97ae-71986002b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1085705332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97df7382-1bed-4875-b873-b58e6ddcf0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e1d6093db440fc9bcf0033e069f68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:38Z,use_quota=True,user_id='404133a4fb774025bf27eb2310ecccce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a18ec0-9371-44dd-bfef-5e04037c4e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a18ec0-9371-44dd-bfef-5e04037c4e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f05611-b78d-4cb3-a2d3-a41d053350ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f05611-b78d-4cb3-a2d3-a41d053350ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97df7382-1bed-4875-b873-b58e6ddcf0c3', 'volume_name': 'volume-97df7382-1bed-4875-b873-b58e6ddcf0c3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b60b70-ec50-4273-b876-11b7ac4b3608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b60b70-ec50-4273-b876-11b7ac4b3608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9afba51-283f-4a8c-9605-b94e6e3b26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:38 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Volume 97df7382-1bed-4875-b873-b58e6ddcf0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97df7382-1bed-4875-b873-b58e6ddcf0c3', 'volume_size': 1} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1085705332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97df7382-1bed-4875-b873-b58e6ddcf0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e1d6093db440fc9bcf0033e069f68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:38Z,use_quota=True,user_id='404133a4fb774025bf27eb2310ecccce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Creating volume 97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:38 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:38 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 1073741824 Jul 30 16:36:38 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:38 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 1073741824" returned: 0 in 0.517s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:38 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 Jul 30 16:36:38 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:39 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3" returned: 0 in 0.314s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9afba51-283f-4a8c-9605-b94e6e3b26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97df7382-1bed-4875-b873-b58e6ddcf0c3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0ce970-0c40-4677-a348-0643a548da70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:39 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Volume volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 (97df7382-1bed-4875-b873-b58e6ddcf0c3): created successfully Jul 30 16:36:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0ce970-0c40-4677-a348-0643a548da70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Flow 'volume_create_manager' (17955d62-c0d1-42d6-b80b-9d94785c1c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-78355396-305e-45a7-8070-ec8f32404ca0 tempest-VolumesSnapshotListTestJSON-1471202196 None] Created volume successfully. Jul 30 16:36:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Creating offline snapshot 4907e973-0016-4890-8ac3-35c30a45140b of volume 97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:36:40 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b009e8ae-6ce6-44bf-88ab-2cd8335ee50e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:40 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 Jul 30 16:36:40 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:40 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD, size 20.69 MB, duration 4.14 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:36:40 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Image download 20.69 MB at 4.99 MB/s Jul 30 16:36:40 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[232e4d56-4ea6-4ddb-aa58-e8ae50f07e43]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:41 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD Jul 30 16:36:41 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:41 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3" returned: 0 in 0.562s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:41 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b 1G Jul 30 16:36:41 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:41 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Temporary image b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c is fetched for user 6831fd69bfe846fe9d84c4b6fd3ac80d. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb76365-12ab-4d7c-93e2-5afb0b730465]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:41 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD Jul 30 16:36:41 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:41 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b 1G" returned: 0 in 0.602s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:41 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b Jul 30 16:36:41 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:41 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:42 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b" returned: 0 in 0.348s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:42 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b is being set with open permissions: ugo+rw Jul 30 16:36:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:42 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b Jul 30 16:36:42 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:42 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b" returned: 0 in 0.390s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:42 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.info Jul 30 16:36:42 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:42 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.info" returned: 0 in 0.272s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:42 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.info is being set with open permissions: ugo+rw Jul 30 16:36:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:42 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.info Jul 30 16:36:42 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:43 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.info" returned: 0 in 0.249s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-93297693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ae134a-da48-4b76-a135-a9e53c58355f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b742a58b78af49b19739808c6f8918ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:36Z,use_quota=True,user_id='6831fd69bfe846fe9d84c4b6fd3ac80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d725e20f-a979-4365-b7be-315f8308f1ca),volume_type_id=d725e20f-a979-4365-b7be-315f8308f1ca)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Creating volume 38ae134a-da48-4b76-a135-a9e53c58355f {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:43 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:43 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f 1073741824 Jul 30 16:36:43 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5ea02c7c-d42f-4a1b-a8b4-7c5798dd9646 tempest-VolumesSnapshotListTestJSON-1471202196 None] Create snapshot completed successfully Jul 30 16:36:43 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f 1073741824" returned: 0 in 0.407s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:43 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f Jul 30 16:36:43 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:43 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f" returned: 0 in 0.262s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:43 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Attempting download of b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c ((None, [{'url': 'file:///opt/stack/data/glance/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'metadata': {}}])) to volume 38ae134a-da48-4b76-a135-a9e53c58355f. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a0ccf-3c81-4da4-ba75-0168da0a86d4]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_eyxrqx8t {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Creating offline snapshot a8adada3-c85a-4e76-92f2-c419a9df4765 of volume 97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e05809-8346-4fef-8c2c-59ff9c742d3c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:44 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_eyxrqx8t Jul 30 16:36:44 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:44 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b Jul 30 16:36:44 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:44 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_eyxrqx8t" returned: 0 in 0.388s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_eyxrqx8t {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:44 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_eyxrqx8t Jul 30 16:36:44 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:44 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b" returned: 0 in 0.393s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97df7382-1bed-4875-b873-b58e6ddcf0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:44 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 1G Jul 30 16:36:44 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e3f0f1a2-8fff-4a88-89f6-fb2579e54987 req-071fcff8-ccf3-4b87-90ed-98c8b0f5292e tempest-AttachVolumeShelveTestJSON-1314642646 None] No connector for attachment fac6b662-8355-49c5-b60f-22cab7a19be5; skipping storage backend terminate_connection call. {{(pid=88095) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-e3f0f1a2-8fff-4a88-89f6-fb2579e54987 req-071fcff8-ccf3-4b87-90ed-98c8b0f5292e tempest-AttachVolumeShelveTestJSON-1314642646 None] Deleting attachment fac6b662-8355-49c5-b60f-22cab7a19be5. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:36:44 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_eyxrqx8t" returned: 1 in 0.353s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_eyxrqx8t' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e87df1f-b64f-4daf-9db3-16483c456043]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:44 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD Jul 30 16:36:44 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:45 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 1G" returned: 0 in 0.535s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:45 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 Jul 30 16:36:45 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:45 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c was qcow2, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:45 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f Jul 30 16:36:45 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:45 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765" returned: 0 in 0.392s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:45 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 is being set with open permissions: ugo+rw Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:45 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 Jul 30 16:36:45 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:45 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765" returned: 0 in 0.252s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.686s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f8bc3817-0b47-497f-9a37-886ebf7087e2 tempest-VolumesSnapshotListTestJSON-1471202196 None] Create snapshot completed successfully Jul 30 16:36:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Creating offline snapshot 629d1b91-dbd2-4215-b078-9a919d284479 of volume 97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:36:46 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[94da6668-cc0b-49c9-b9e9-d756464349de]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:46 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 Jul 30 16:36:46 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:46 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765" returned: 0 in 0.441s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97df7382-1bed-4875-b873-b58e6ddcf0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:46 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 1G Jul 30 16:36:46 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:47 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f" returned: 0 in 2.133s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c_2wcac5dqdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:36:47 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Converted 112.00 MB image at 52.46 MB/s Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:47 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f 1G Jul 30 16:36:47 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:47 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:36:47 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:47 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 1G" returned: 0 in 0.581s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:47 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 Jul 30 16:36:47 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:47 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f 1G" returned: 0 in 0.382s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Downloaded image b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c ((None, [{'url': 'file:///opt/stack/data/glance/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'metadata': {}}])) to volume 38ae134a-da48-4b76-a135-a9e53c58355f successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Temporary image b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c for user 6831fd69bfe846fe9d84c4b6fd3ac80d is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Marking volume 38ae134a-da48-4b76-a135-a9e53c58355f as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:36:47 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.311s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Copying metadata from image b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c to 38ae134a-da48-4b76-a135-a9e53c58355f. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Creating volume glance metadata for volume 38ae134a-da48-4b76-a135-a9e53c58355f backed by image b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c with: {'image_id': 'b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'image_name': 'tempest-scenario-img--1459330726', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:36:47 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a1cb8b-4365-4cd1-9b37-f32e2d9d9e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ae134a-da48-4b76-a135-a9e53c58355f', 'volume_size': 1, 'image_id': 'b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1459330726', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b742a58b78af49b19739808c6f8918ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c', 'created_at': datetime.datetime(2026, 7, 30, 14, 36, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 36, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0ebc1a3-27d9-4ca1-a6ea-8429e13cda9c/file', 'properties': {}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbabc1c1-759a-4f08-8e76-7bb1a3be09ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479" returned: 0 in 0.357s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:47 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 is being set with open permissions: ugo+rw Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:47 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Volume volume-38ae134a-da48-4b76-a135-a9e53c58355f (38ae134a-da48-4b76-a135-a9e53c58355f): created successfully Jul 30 16:36:47 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 Jul 30 16:36:47 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbabc1c1-759a-4f08-8e76-7bb1a3be09ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Flow 'volume_create_manager' (71fecf2c-5eac-4464-bcb1-867929f73087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d3ae5afa-d691-4956-a9b3-31e882ec2a72 tempest-TestInstancesWithCinderVolumes-1165442800 None] Created volume successfully. Jul 30 16:36:48 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479" returned: 0 in 0.396s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5904a3a5-0c52-41f7-aa87-df12fe652eba tempest-VolumesSnapshotListTestJSON-1471202196 None] Create snapshot completed successfully Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2bbb6979-ad1a-4d12-9de8-584f976c7f25 req-5b18eeba-d7d0-4533-95c5-7383a1d71463 tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2bbb6979-ad1a-4d12-9de8-584f976c7f25 req-5b18eeba-d7d0-4533-95c5-7383a1d71463 tempest-TestStampPattern-1018346385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2bbb6979-ad1a-4d12-9de8-584f976c7f25 req-5b18eeba-d7d0-4533-95c5-7383a1d71463 tempest-TestStampPattern-1018346385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-2bbb6979-ad1a-4d12-9de8-584f976c7f25 req-5b18eeba-d7d0-4533-95c5-7383a1d71463 tempest-TestStampPattern-1018346385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-07682602-f729-4e74-bf68-a26e0697a77a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '690b90e0-d513-4844-b0ec-768bbab1fc22', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:36:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-2bbb6979-ad1a-4d12-9de8-584f976c7f25 req-5b18eeba-d7d0-4533-95c5-7383a1d71463 tempest-TestStampPattern-1018346385 None] attachment_update completed successfully. Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-629d1b91-dbd2-4215-b078-9a919d284479-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-629d1b91-dbd2-4215-b078-9a919d284479-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-quobyte-629d1b91-dbd2-4215-b078-9a919d284479" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-629d1b91-dbd2-4215-b078-9a919d284479" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Deleting offline snapshot 629d1b91-dbd2-4215-b078-9a919d284479 of volume 97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] snapshot_file for this snap is: volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a2beb-d1d4-4c4e-9d5e-0a89fa481475]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:49 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 Jul 30 16:36:49 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:50 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479" returned: 0 in 0.669s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97df7382-1bed-4875-b873-b58e6ddcf0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd9112-63de-4626-a3fa-ce2ec48caf0b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:50 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 Jul 30 16:36:50 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:51 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765" returned: 0 in 0.635s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97df7382-1bed-4875-b873-b58e6ddcf0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:51 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 Jul 30 16:36:51 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:51 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479" returned: 0 in 0.719s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:51 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479 Jul 30 16:36:51 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:52 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.629d1b91-dbd2-4215-b078-9a919d284479" returned: 0 in 0.418s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-629d1b91-dbd2-4215-b078-9a919d284479" released by "_delete_snapshot" :: held 2.617s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" released by "delete_snapshot" :: held 2.664s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-535396ec-90be-42b0-8278-e717bac8dfc3 req-26300068-08c5-4f6a-a12c-57c29a6052f8 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-535396ec-90be-42b0-8278-e717bac8dfc3 req-26300068-08c5-4f6a-a12c-57c29a6052f8 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-535396ec-90be-42b0-8278-e717bac8dfc3 req-26300068-08c5-4f6a-a12c-57c29a6052f8 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Created reservations ['cc65a97f-f7cc-4fbc-a2c6-01749d2c81af', '6c495a93-e249-4139-ad57-6c1e917a2f13', '2c282611-b033-4494-968f-bcce5ff59b2b', '0fab75c5-1ce3-4e7b-814d-5c176cc3d32a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-535396ec-90be-42b0-8278-e717bac8dfc3 req-26300068-08c5-4f6a-a12c-57c29a6052f8 tempest-TestInstancesWithCinderVolumes-1165442800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-38ae134a-da48-4b76-a135-a9e53c58355f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afaebbcf-a6df-4d3d-95de-ce5de87dcd81', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:36:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-535396ec-90be-42b0-8278-e717bac8dfc3 req-26300068-08c5-4f6a-a12c-57c29a6052f8 tempest-TestInstancesWithCinderVolumes-1165442800 None] attachment_update completed successfully. Jul 30 16:36:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Delete snapshot completed successfully. Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6ef86db2-e6fa-4617-ae60-385cb53df717 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-629d1b91-dbd2-4215-b078-9a919d284479-delete_snapshot" released by "delete_snapshot" :: held 2.992s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-a8adada3-c85a-4e76-92f2-c419a9df4765-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-a8adada3-c85a-4e76-92f2-c419a9df4765-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-quobyte-a8adada3-c85a-4e76-92f2-c419a9df4765" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-a8adada3-c85a-4e76-92f2-c419a9df4765" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Deleting offline snapshot a8adada3-c85a-4e76-92f2-c419a9df4765 of volume 97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:36:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] snapshot_file for this snap is: volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:36:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd89190-25af-4e47-a350-8550269d9aba]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:53 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 Jul 30 16:36:53 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:53 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765" returned: 0 in 0.523s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97df7382-1bed-4875-b873-b58e6ddcf0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a3a1fc-c9c3-470f-a2dd-537e2817c1c6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:53 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b Jul 30 16:36:53 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:54 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b" returned: 0 in 0.545s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97df7382-1bed-4875-b873-b58e6ddcf0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:54 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 Jul 30 16:36:54 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:54 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765" returned: 0 in 0.644s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:54 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765 Jul 30 16:36:54 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:55 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.a8adada3-c85a-4e76-92f2-c419a9df4765" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-a8adada3-c85a-4e76-92f2-c419a9df4765" released by "_delete_snapshot" :: held 2.265s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" released by "delete_snapshot" :: held 2.307s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:55 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Created reservations ['e72f9f67-dab2-4b43-a5f5-09cca95dfceb', '1de44146-3449-4204-b368-314e676a166b', '7e087de6-1908-4e01-8c4d-71c0dd791f9f', 'ddc47a03-d581-478c-8177-8fcd1c35fcce'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:55 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Delete snapshot completed successfully. Jul 30 16:36:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2ff8ec-b8c5-4ef0-bd03-a6eac193fe2b tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-a8adada3-c85a-4e76-92f2-c419a9df4765-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-a5e35c53-9a2d-426e-85e8-fc5eb8514203 req-d4b8873f-8f03-425a-a00d-f93617780646 tempest-TestStampPattern-1018346385 None] Terminate volume connection completed successfully. Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-a5e35c53-9a2d-426e-85e8-fc5eb8514203 req-d4b8873f-8f03-425a-a00d-f93617780646 tempest-TestStampPattern-1018346385 None] Deleting attachment 690b90e0-d513-4844-b0ec-768bbab1fc22. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-4907e973-0016-4890-8ac3-35c30a45140b-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-4907e973-0016-4890-8ac3-35c30a45140b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-quobyte-4907e973-0016-4890-8ac3-35c30a45140b" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-4907e973-0016-4890-8ac3-35c30a45140b" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Deleting offline snapshot 4907e973-0016-4890-8ac3-35c30a45140b of volume 97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] snapshot_file for this snap is: volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a327887a-8ec0-43fe-b693-61fa63f31e51]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:56 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b Jul 30 16:36:56 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b" returned: 0 in 0.749s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:57 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97df7382-1bed-4875-b873-b58e6ddcf0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:57 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[09420759-40a8-40c6-9ab9-72a50f5e5011]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:57 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 Jul 30 16:36:57 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:58 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Creating offline snapshot d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 of volume 07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:36:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3" returned: 0 in 0.888s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ffebd6-4fcf-4417-aa3e-bfffc2d54ef5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:58 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b Jul 30 16:36:58 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:58 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a Jul 30 16:36:58 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-535396ec-90be-42b0-8278-e717bac8dfc3 req-337545e2-6fd8-49c8-bd1f-67d0cf30cf5c tempest-TestInstancesWithCinderVolumes-1165442800 None] Terminate volume connection completed successfully. Jul 30 16:36:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-535396ec-90be-42b0-8278-e717bac8dfc3 req-337545e2-6fd8-49c8-bd1f-67d0cf30cf5c tempest-TestInstancesWithCinderVolumes-1165442800 None] Deleting attachment afaebbcf-a6df-4d3d-95de-ce5de87dcd81. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:36:59 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b" returned: 0 in 0.903s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:59 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a" returned: 0 in 0.900s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:59 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b Jul 30 16:36:59 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:59 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 1G Jul 30 16:36:59 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:59 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3.4907e973-0016-4890-8ac3-35c30a45140b" returned: 0 in 0.546s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-4907e973-0016-4890-8ac3-35c30a45140b" released by "_delete_snapshot" :: held 3.352s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" released by "delete_snapshot" :: held 3.437s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Created reservations ['426ca588-1daf-4349-b163-5f9c095d311e', 'cbcb6c43-76ca-4e5b-92bb-4a713ba0f308', '076ee60e-c486-4dea-92da-6d2ca2856af2', 'f2a66302-b76b-4c39-8a0c-7661d4a84d96'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Delete snapshot completed successfully. Jul 30 16:36:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a0a319ec-bbcb-446d-9cea-74f52b2f8778 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-4907e973-0016-4890-8ac3-35c30a45140b-delete_snapshot" released by "delete_snapshot" :: held 3.660s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:00 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 1G" returned: 0 in 0.772s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07682602-f729-4e74-bf68-a26e0697a77a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:00 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07682602-f729-4e74-bf68-a26e0697a77a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 Jul 30 16:37:00 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:00 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07682602-f729-4e74-bf68-a26e0697a77a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" returned: 0 in 0.428s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:00 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 is being set with open permissions: ugo+rw Jul 30 16:37:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:00 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 Jul 30 16:37:00 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:00 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" returned: 0 in 0.495s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-97df7382-1bed-4875-b873-b58e6ddcf0c3-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-97df7382-1bed-4875-b873-b58e6ddcf0c3-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:01 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.info Jul 30 16:37:01 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" acquired by "delete_volume" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[491d1e69-b637-46ac-a48b-8b8fa9a05bd6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:01 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 Jul 30 16:37:01 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:01 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.info" returned: 0 in 0.455s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:01 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.info is being set with open permissions: ugo+rw Jul 30 16:37:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:01 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.info Jul 30 16:37:01 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:02 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3" returned: 0 in 0.833s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:02 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3 Jul 30 16:37:02 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:02 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.info" returned: 0 in 0.698s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.991s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-264cfc05-b301-43c8-9e13-e2e0664838fe tempest-TestStampPattern-1018346385 None] Create snapshot completed successfully Jul 30 16:37:02 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-97df7382-1bed-4875-b873-b58e6ddcf0c3" returned: 0 in 0.375s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-quobyte-97df7382-1bed-4875-b873-b58e6ddcf0c3" released by "delete_volume" :: held 1.308s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Created reservations ['f450e715-b1cb-406e-b4e8-74b8d3efe0ad', 'e9185321-a210-45ed-aa86-dab271061603', 'd149131f-22ad-4b0c-85fb-53143f7b83e2', '6b5f4967-7345-4296-8679-000dbb39153d'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:02 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:37:02 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:02 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.313s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Deleted volume successfully. Jul 30 16:37:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2301af8-f8d1-439f-86d5-056b3b09ec08 tempest-VolumesSnapshotListTestJSON-1471202196 None] Lock "cinder-97df7382-1bed-4875-b873-b58e6ddcf0c3-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "cinder-38ae134a-da48-4b76-a135-a9e53c58355f-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-38ae134a-da48-4b76-a135-a9e53c58355f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:04 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=111,cinder:SELECT=103,cinder:INSERT=37,cinder:DELETE=7 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:37:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "cinder-quobyte-38ae134a-da48-4b76-a135-a9e53c58355f" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-quobyte-38ae134a-da48-4b76-a135-a9e53c58355f" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeedb709-9f6c-4f4c-85c4-86a508af913b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:05 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f Jul 30 16:37:05 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:05 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f" returned: 0 in 0.544s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:05 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f Jul 30 16:37:05 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:05 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-38ae134a-da48-4b76-a135-a9e53c58355f" returned: 0 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-quobyte-38ae134a-da48-4b76-a135-a9e53c58355f" released by "delete_volume" :: held 0.941s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:06 devstack cinder-volume[88095]: WARNING cinder.quota [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-22173535-681839112 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-22173535-681839112, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:37:06 devstack cinder-volume[88095]: WARNING cinder.quota [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-22173535-681839112 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-22173535-681839112, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Created reservations ['aa125faf-922f-431e-a1a7-788e0c3d684e', '84bcf821-f0d1-41fe-a2f0-fe86ac169881', 'e816b43e-a46f-4fd9-b97d-3174d3364a6d', 'f797ee5e-7413-4975-8139-d4c262eea826'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:06 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:37:06 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:06 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.351s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:06 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Deleted volume successfully. Jul 30 16:37:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-aa415659-fe54-4896-988f-e67f6e75a81c tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-38ae134a-da48-4b76-a135-a9e53c58355f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "cinder-e6088719-11ca-464e-8ad7-289b2dcd1809-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-e6088719-11ca-464e-8ad7-289b2dcd1809-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "cinder-quobyte-e6088719-11ca-464e-8ad7-289b2dcd1809" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-quobyte-e6088719-11ca-464e-8ad7-289b2dcd1809" acquired by "delete_volume" :: waited 0.038s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d63d6b8-fbc3-46ca-88e7-333aa50c4f62]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:07 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 Jul 30 16:37:07 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Flow 'volume_create_manager' (e4ba9339-1612-4cb1-9b56-b2775e1ca0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25f3fbf-5d3a-4c86-9b8e-21207f732415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25f3fbf-5d3a-4c86-9b8e-21207f732415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1506945948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c419145a-90da-43c5-8ee0-79a0175b9017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088d9bf7ea040a6be54a2eaa08a294a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:08Z,use_quota=True,user_id='e764dbc3bc66449ebd90ef05840c3c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9885df0c-9c19-49ec-b00d-050636f80445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9885df0c-9c19-49ec-b00d-050636f80445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c962430e-5539-4375-af4a-d50bdb6fc75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c962430e-5539-4375-af4a-d50bdb6fc75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c419145a-90da-43c5-8ee0-79a0175b9017', 'volume_name': 'volume-c419145a-90da-43c5-8ee0-79a0175b9017', 'volume_size': 2}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88534b22-8595-4a6f-b337-bb7da767f197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88534b22-8595-4a6f-b337-bb7da767f197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b48f5d-aebd-4932-8090-7fdec9d1fab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Volume c419145a-90da-43c5-8ee0-79a0175b9017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c419145a-90da-43c5-8ee0-79a0175b9017', 'volume_size': 2} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1506945948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c419145a-90da-43c5-8ee0-79a0175b9017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088d9bf7ea040a6be54a2eaa08a294a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:08Z,use_quota=True,user_id='e764dbc3bc66449ebd90ef05840c3c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Creating volume c419145a-90da-43c5-8ee0-79a0175b9017 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:08 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 2147483648 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:08 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 2147483648 Jul 30 16:37:08 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:08 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809" returned: 0 in 0.655s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:08 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809 Jul 30 16:37:08 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:08 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6088719-11ca-464e-8ad7-289b2dcd1809" returned: 0 in 0.311s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-quobyte-e6088719-11ca-464e-8ad7-289b2dcd1809" released by "delete_volume" :: held 1.034s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:08 devstack cinder-volume[88095]: WARNING cinder.quota [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-315761170-396534730 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-315761170-396534730, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:37:08 devstack cinder-volume[88095]: WARNING cinder.quota [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-315761170-396534730 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-315761170-396534730, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Created reservations ['9d0b9327-b074-40ae-9921-679dab3145c3', '57693c3a-be8f-4363-8b16-9e5974716f5c', '66615f94-9c2c-4bef-a8c4-ca2862225d3f', '3a73dd9d-6e17-4a5a-951e-95bd9a8b8d4a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:08 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:37:08 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:08 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 2147483648" returned: 0 in 0.667s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:08 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 Jul 30 16:37:08 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:09 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:09 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017" returned: 0 in 0.286s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.403s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Deleted volume successfully. Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b48f5d-aebd-4932-8090-7fdec9d1fab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c419145a-90da-43c5-8ee0-79a0175b9017', 'volume_size': 2}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831abd1a-11b7-4556-84e3-84996d77edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0f386bb7-945f-4306-b20d-c958db463bb2 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-e6088719-11ca-464e-8ad7-289b2dcd1809-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:09 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Volume volume-c419145a-90da-43c5-8ee0-79a0175b9017 (c419145a-90da-43c5-8ee0-79a0175b9017): created successfully Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831abd1a-11b7-4556-84e3-84996d77edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Flow 'volume_create_manager' (e4ba9339-1612-4cb1-9b56-b2775e1ca0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cb5f12f7-8dc9-4f0e-a479-bf6431a50609 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Created volume successfully. Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "cinder-7f0f038b-e066-4b55-96d8-ee44f933c611-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-7f0f038b-e066-4b55-96d8-ee44f933c611-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "cinder-quobyte-7f0f038b-e066-4b55-96d8-ee44f933c611" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-quobyte-7f0f038b-e066-4b55-96d8-ee44f933c611" acquired by "delete_volume" :: waited 0.043s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[826f505e-6ee8-46c0-8718-bba7d27772fa]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:09 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 Jul 30 16:37:09 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Creating offline snapshot 5eb4c483-44fc-4486-b4f4-079c0fc2890f of volume c419145a-90da-43c5-8ee0-79a0175b9017 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f3929-2dfe-4558-b0b3-2721316c1688]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:10 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611" returned: 0 in 0.653s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:10 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611 Jul 30 16:37:10 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:10 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 Jul 30 16:37:10 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:10 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7f0f038b-e066-4b55-96d8-ee44f933c611" returned: 0 in 0.336s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-quobyte-7f0f038b-e066-4b55-96d8-ee44f933c611" released by "delete_volume" :: held 1.062s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:10 devstack cinder-volume[88095]: WARNING cinder.quota [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-220346917-580441910 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-220346917-580441910, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:37:10 devstack cinder-volume[88095]: WARNING cinder.quota [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-220346917-580441910 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-220346917-580441910, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Created reservations ['97fb36b1-2a32-4aad-b121-cbfa2653e2d6', '24688f83-c78e-4f69-bd61-b104479c6364', '7c049f7b-e790-4a1c-9620-89c121c3c3ba', 'c3e9a07e-117b-49c5-8230-a8c2acb313c7'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:10 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017" returned: 0 in 0.497s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f 2G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:10 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f 2G Jul 30 16:37:10 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:11 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:37:11 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:11 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.343s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Deleted volume successfully. Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-92e8bf4b-bcb2-40ff-b782-90f3e925b2c7 tempest-TestInstancesWithCinderVolumes-1165442800 None] Lock "cinder-7f0f038b-e066-4b55-96d8-ee44f933c611-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:11 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f 2G" returned: 0 in 0.559s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419145a-90da-43c5-8ee0-79a0175b9017 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:11 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419145a-90da-43c5-8ee0-79a0175b9017 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f Jul 30 16:37:11 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:11 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419145a-90da-43c5-8ee0-79a0175b9017 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f" returned: 0 in 0.331s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:11 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f is being set with open permissions: ugo+rw Jul 30 16:37:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:11 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f Jul 30 16:37:11 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Flow 'volume_create_manager' (c26cf62a-1424-4721-a4ba-cd5bcb8cbe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7530d973-37da-4513-a2f0-364d6cca6d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:12 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f" returned: 0 in 0.389s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7530d973-37da-4513-a2f0-364d6cca6d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2118959968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24eaf638-3f27-44a9-b94b-5f8be447e0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322b5199c6c849b089a7c76b8ca1e87e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2f23260-15ef-4d7d-9d18-c3ca4fb4d144,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:12Z,use_quota=True,user_id='84ded5636a564a80be8a272907f9ce9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6746d1-a037-445b-ad4b-5e213d54f0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6746d1-a037-445b-ad4b-5e213d54f0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f50a0f7-2ca8-4c0d-aea5-2cabb3656b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f50a0f7-2ca8-4c0d-aea5-2cabb3656b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24eaf638-3f27-44a9-b94b-5f8be447e0a5', 'volume_name': 'volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5', 'volume_size': 1, 'snapshot_id': 'd2f23260-15ef-4d7d-9d18-c3ca4fb4d144'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40463387-128b-45a0-804d-1fb7c90be13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40463387-128b-45a0-804d-1fb7c90be13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f3e765-750d-4382-8a29-35c4f0827117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:12 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Volume 24eaf638-3f27-44a9-b94b-5f8be447e0a5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5', 'volume_size': 1, 'snapshot_id': 'd2f23260-15ef-4d7d-9d18-c3ca4fb4d144'} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:12 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.info Jul 30 16:37:12 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:12 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.info" returned: 0 in 0.452s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:12 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.info is being set with open permissions: ugo+rw Jul 30 16:37:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:12 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.info Jul 30 16:37:12 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:13 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.info" returned: 0 in 0.338s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.767s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.880s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-quobyte-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144-24eaf638-3f27-44a9-b94b-5f8be447e0a5" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144-24eaf638-3f27-44a9-b94b-5f8be447e0a5" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Creating volume 24eaf638-3f27-44a9-b94b-5f8be447e0a5 from snapshot d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-quobyte-24eaf638-3f27-44a9-b94b-5f8be447e0a5" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a8097137-a4c3-4a0c-943e-4767a50bbc4f tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Create snapshot completed successfully Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-24eaf638-3f27-44a9-b94b-5f8be447e0a5" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] snapshot: d2f23260-15ef-4d7d-9d18-c3ca4fb4d144, volume: 24eaf638-3f27-44a9-b94b-5f8be447e0a5, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24aaf720-abcf-4918-83f8-025f93fee65e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:13 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 Jul 30 16:37:13 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:13 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" returned: 0 in 0.553s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07682602-f729-4e74-bf68-a26e0697a77a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "cinder-5eb4c483-44fc-4486-b4f4-079c0fc2890f-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce805d04-a723-46a7-aa10-936750739897]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-5eb4c483-44fc-4486-b4f4-079c0fc2890f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "cinder-quobyte-c419145a-90da-43c5-8ee0-79a0175b9017" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-quobyte-c419145a-90da-43c5-8ee0-79a0175b9017" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "cinder-quobyte-5eb4c483-44fc-4486-b4f4-079c0fc2890f" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-quobyte-5eb4c483-44fc-4486-b4f4-079c0fc2890f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Deleting offline snapshot 5eb4c483-44fc-4486-b4f4-079c0fc2890f of volume c419145a-90da-43c5-8ee0-79a0175b9017 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] snapshot_file for this snap is: volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[421bb689-3d1e-464a-a931-5410671cd9ae]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:14 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a Jul 30 16:37:14 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:14 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f Jul 30 16:37:14 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:14 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a" returned: 0 in 0.806s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:14 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 Jul 30 16:37:14 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:14 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f" returned: 0 in 0.808s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c419145a-90da-43c5-8ee0-79a0175b9017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:15 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f80a02-30ed-4f68-b8fa-19ec2ede9576]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:15 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 Jul 30 16:37:15 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:15 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017" returned: 0 in 0.524s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:15 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f Jul 30 16:37:15 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:16 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f" returned: 0 in 0.956s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:16 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f Jul 30 16:37:16 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:17 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017.5eb4c483-44fc-4486-b4f4-079c0fc2890f" returned: 0 in 0.522s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-quobyte-5eb4c483-44fc-4486-b4f4-079c0fc2890f" released by "_delete_snapshot" :: held 3.100s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-quobyte-c419145a-90da-43c5-8ee0-79a0175b9017" released by "delete_snapshot" :: held 3.148s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:17 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Created reservations ['a4090488-5fc8-49ae-8d0b-6aaa2131d430', 'a134d330-6892-4a90-8902-757eded61a0c', 'a547067b-9bb5-4f3d-a3b0-1655c1d9c7e1', 'f159912b-d7f1-479d-93b0-251c337178ff'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Delete snapshot completed successfully. Jul 30 16:37:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3c7185b0-f18f-4fc5-9a2a-6ed7d6228b78 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-5eb4c483-44fc-4486-b4f4-079c0fc2890f-delete_snapshot" released by "delete_snapshot" :: held 3.575s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "cinder-c419145a-90da-43c5-8ee0-79a0175b9017-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-c419145a-90da-43c5-8ee0-79a0175b9017-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "cinder-quobyte-c419145a-90da-43c5-8ee0-79a0175b9017" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-quobyte-c419145a-90da-43c5-8ee0-79a0175b9017" acquired by "delete_volume" :: waited 0.056s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:19 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a9430e-956a-4916-8f01-60b35a98db66]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:19 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 Jul 30 16:37:19 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:21 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017" returned: 0 in 1.687s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:21 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017 Jul 30 16:37:21 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:21 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c419145a-90da-43c5-8ee0-79a0175b9017" returned: 0 in 0.746s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-quobyte-c419145a-90da-43c5-8ee0-79a0175b9017" released by "delete_volume" :: held 2.649s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Created reservations ['a1e1be93-8225-4128-9f80-9ad0c761ea6e', 'a33afc09-875c-43d7-97a8-c274385ec929', '57ae8ac9-edc7-466b-b861-9769b5dcf207', 'ba77b64a-6091-4f5c-a9ca-7801a001dcb1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:22 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5" returned: 0 in 7.569s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:37:22 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Converted 1024.00 MB image at 135.28 MB/s Jul 30 16:37:22 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 is being set with open permissions: ugo+rw Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:22 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 Jul 30 16:37:22 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:22 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:37:22 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:22 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.451s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:22 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5" returned: 0 in 0.523s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:22 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Deleted volume successfully. Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-24eaf638-3f27-44a9-b94b-5f8be447e0a5" released by "_copy_volume_from_snapshot" :: held 9.615s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d9eb214d-95dd-4ddf-865a-26029a4643a9 tempest-VolumesSnapshotNegativeTestJSON-672638362 None] Lock "cinder-c419145a-90da-43c5-8ee0-79a0175b9017-delete_volume" released by "delete_volume" :: held 3.816s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144-24eaf638-3f27-44a9-b94b-5f8be447e0a5" released by "_create_volume_from_snapshot" :: held 9.741s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.780s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f3e765-750d-4382-8a29-35c4f0827117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5', 'volume_size': 1, 'snapshot_id': 'd2f23260-15ef-4d7d-9d18-c3ca4fb4d144'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4dc881a-688c-454d-9d9f-d18bd97cdbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:23 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Volume volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 (24eaf638-3f27-44a9-b94b-5f8be447e0a5): created successfully Jul 30 16:37:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4dc881a-688c-454d-9d9f-d18bd97cdbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Flow 'volume_create_manager' (c26cf62a-1424-4721-a4ba-cd5bcb8cbe86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:23 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-89efe623-d86a-4a4d-8071-9af317d5785c tempest-TestStampPattern-1018346385 None] Created volume successfully. Jul 30 16:37:33 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=35,cinder:INSERT=12,cinder:UPDATE=44,cinder:DELETE=4 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:37:33 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=108,cinder:INSERT=30,cinder:UPDATE=107,cinder:DELETE=12 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:37:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Acquiring lock "cinder-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "cinder-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Acquiring lock "cinder-quobyte-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "cinder-quobyte-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13" acquired by "delete_volume" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:35 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41757228-0b11-43df-8abd-72c92ab140b6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:35 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 Jul 30 16:37:35 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:36 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13" returned: 0 in 0.620s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:36 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13 Jul 30 16:37:36 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:36 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13" returned: 0 in 0.447s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "cinder-quobyte-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13" released by "delete_volume" :: held 1.149s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Created reservations ['ea21d4a8-a240-4589-a9d2-10acebca2503', '72dbd6b1-8866-404d-b91e-3c706966910c', '097d6727-04fb-4ff7-88f6-16e56b0bebe8', '863fd321-1ebc-4b5f-8e25-a407a24d3a64'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:36 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:37:36 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:37 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.540s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:37 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Deleted volume successfully. Jul 30 16:37:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610f2cc2-3e4a-4be1-98b8-c4a50651301c tempest-AttachVolumeShelveTestJSON-1314642646 None] Lock "cinder-3e336c2c-5d3a-4b69-988c-3ea0b8eaca13-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:46 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=3,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:47 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:37:47 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:37:47 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.314s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:37:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:38:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-aa05bd8b-3b4a-4f5c-99df-3fd81d3c2f63 req-18992414-fd47-427a-b21c-5fb807048084 tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-aa05bd8b-3b4a-4f5c-99df-3fd81d3c2f63 req-18992414-fd47-427a-b21c-5fb807048084 tempest-TestStampPattern-1018346385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-aa05bd8b-3b4a-4f5c-99df-3fd81d3c2f63 req-18992414-fd47-427a-b21c-5fb807048084 tempest-TestStampPattern-1018346385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-aa05bd8b-3b4a-4f5c-99df-3fd81d3c2f63 req-18992414-fd47-427a-b21c-5fb807048084 tempest-TestStampPattern-1018346385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b08b7fb-86da-4a47-9063-34017a6a74df', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:38:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-aa05bd8b-3b4a-4f5c-99df-3fd81d3c2f63 req-18992414-fd47-427a-b21c-5fb807048084 tempest-TestStampPattern-1018346385 None] attachment_update completed successfully. Jul 30 16:38:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-28c5d5b7-ee34-45ad-9930-022ca0498e86 req-e2ee2666-2510-4251-abad-866a478e2bdd tempest-TestStampPattern-1018346385 None] Terminate volume connection completed successfully. Jul 30 16:38:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-28c5d5b7-ee34-45ad-9930-022ca0498e86 req-e2ee2666-2510-4251-abad-866a478e2bdd tempest-TestStampPattern-1018346385 None] Deleting attachment 3b08b7fb-86da-4a47-9063-34017a6a74df. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:38:10 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:38:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-24eaf638-3f27-44a9-b94b-5f8be447e0a5-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Lock "cinder-24eaf638-3f27-44a9-b94b-5f8be447e0a5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-quobyte-24eaf638-3f27-44a9-b94b-5f8be447e0a5" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-24eaf638-3f27-44a9-b94b-5f8be447e0a5" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be9efe3-447c-4024-b5e8-395b0f61b523]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:14 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 Jul 30 16:38:14 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:14 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5" returned: 0 in 0.505s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:14 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5 Jul 30 16:38:14 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:14 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-24eaf638-3f27-44a9-b94b-5f8be447e0a5" returned: 0 in 0.387s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-24eaf638-3f27-44a9-b94b-5f8be447e0a5" released by "delete_volume" :: held 0.963s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Created reservations ['85e8fe8d-890a-40f0-ae2c-836f9f030663', '1c1a8935-e341-4c29-8273-febe9cdf2713', '97621bcd-3094-4855-8a98-1eb16dffe93f', 'b111f075-b629-46d6-b91e-073c939894bc'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:15 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:38:15 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:15 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.314s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:15 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:38:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Deleted volume successfully. Jul 30 16:38:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c581820e-719f-4391-b8c3-a07bc00f9f07 tempest-TestStampPattern-1018346385 None] Lock "cinder-24eaf638-3f27-44a9-b94b-5f8be447e0a5-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Lock "cinder-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-quobyte-07682602-f729-4e74-bf68-a26e0697a77a" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-07682602-f729-4e74-bf68-a26e0697a77a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-quobyte-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Deleting offline snapshot d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 of volume 07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] snapshot_file for this snap is: volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[997abd90-01b1-42dd-93cb-bcd29d3cbaad]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:16 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 Jul 30 16:38:16 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:17 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" returned: 0 in 0.486s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07682602-f729-4e74-bf68-a26e0697a77a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:38:17 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b4461b-3825-4527-aac7-61fccb4feaeb]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:17 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a Jul 30 16:38:17 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:17 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a" returned: 0 in 0.704s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:17 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 Jul 30 16:38:17 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:18 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" returned: 0 in 0.843s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:18 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144 Jul 30 16:38:18 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:19 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a.d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" returned: 0 in 0.544s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144" released by "_delete_snapshot" :: held 2.800s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-07682602-f729-4e74-bf68-a26e0697a77a" released by "delete_snapshot" :: held 2.842s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:19 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Created reservations ['b05cac19-aa22-44e1-ba17-84f1e19a1c57', '5f2b8937-0c70-460a-9291-5e297830d4d5', '45f85919-8659-4892-b802-b26e05aca49f', '8eafad98-efd6-42c8-b71f-6ef2af5bcc8c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:19 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Delete snapshot completed successfully. Jul 30 16:38:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4267b7a-8db7-46d8-b61f-e44829b64660 tempest-TestStampPattern-1018346385 None] Lock "cinder-d2f23260-15ef-4d7d-9d18-c3ca4fb4d144-delete_snapshot" released by "delete_snapshot" :: held 3.076s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-07682602-f729-4e74-bf68-a26e0697a77a-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Lock "cinder-07682602-f729-4e74-bf68-a26e0697a77a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Acquiring lock "cinder-quobyte-07682602-f729-4e74-bf68-a26e0697a77a" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-07682602-f729-4e74-bf68-a26e0697a77a" acquired by "delete_volume" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:27 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[068a13cd-39ac-466d-854f-f7fab9677dba]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:28 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a Jul 30 16:38:28 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Flow 'volume_create_manager' (539e20a0-3eb0-410c-b978-904fe5fc1e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73463b4-0724-43c0-83d8-957be81b3d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73463b4-0724-43c0-83d8-957be81b3d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-416376415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1329b3da-a847-44fb-a18d-9054cb772d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a2f5e57714a37afd26518462d99ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:28Z,use_quota=True,user_id='a61314cd05944f4392d5489b0d86dd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb7bb95-3ebd-4fb1-a78d-aef9f8f7af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb7bb95-3ebd-4fb1-a78d-aef9f8f7af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2349208-595a-4a97-b480-013bb11e4785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2349208-595a-4a97-b480-013bb11e4785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1329b3da-a847-44fb-a18d-9054cb772d43', 'volume_name': 'volume-1329b3da-a847-44fb-a18d-9054cb772d43', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab168717-16f5-43fd-aa0a-60192ec1062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab168717-16f5-43fd-aa0a-60192ec1062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b271e4e-206e-4473-91eb-6c96f3777d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Volume 1329b3da-a847-44fb-a18d-9054cb772d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1329b3da-a847-44fb-a18d-9054cb772d43', 'volume_size': 1} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-416376415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1329b3da-a847-44fb-a18d-9054cb772d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5a2f5e57714a37afd26518462d99ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:28Z,use_quota=True,user_id='a61314cd05944f4392d5489b0d86dd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Creating volume 1329b3da-a847-44fb-a18d-9054cb772d43 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:28 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:28 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 1073741824 Jul 30 16:38:28 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:28 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a" returned: 0 in 1.065s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:28 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a Jul 30 16:38:28 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:29 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 1073741824" returned: 0 in 0.896s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:29 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07682602-f729-4e74-bf68-a26e0697a77a" returned: 0 in 0.627s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Lock "cinder-quobyte-07682602-f729-4e74-bf68-a26e0697a77a" released by "delete_volume" :: held 1.866s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Created reservations ['e61f1cda-dff8-45e0-af18-c93e7fd26e3c', '2e02eb01-6e2b-4963-b645-0b3b3e4e3f48', 'd362a47a-a817-47c2-85f8-19aa9c07f7c5', '1cba9c24-9508-4f90-97f6-78626e79a55e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:29 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 Jul 30 16:38:29 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:29 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:38:29 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:30 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43" returned: 0 in 0.638s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b271e4e-206e-4473-91eb-6c96f3777d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1329b3da-a847-44fb-a18d-9054cb772d43', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a538df-99f4-4ed7-a949-67e71cdba170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Volume volume-1329b3da-a847-44fb-a18d-9054cb772d43 (1329b3da-a847-44fb-a18d-9054cb772d43): created successfully Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a538df-99f4-4ed7-a949-67e71cdba170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Flow 'volume_create_manager' (539e20a0-3eb0-410c-b978-904fe5fc1e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5dca22ab-5ddc-472a-a0bb-b69ad4186919 tempest-TestMinimumBasicScenario-81492806 None] Created volume successfully. Jul 30 16:38:30 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.989s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:38:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Deleted volume successfully. Jul 30 16:38:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e70b887-90a2-4164-a01a-93be48d33a01 tempest-TestStampPattern-1018346385 None] Lock "cinder-07682602-f729-4e74-bf68-a26e0697a77a-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-fe3e78ea-b1b9-4a86-935a-1fd9b8b6b996 req-7a2948c3-0cdf-4a8e-a681-b8c994889763 tempest-TestMinimumBasicScenario-81492806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-fe3e78ea-b1b9-4a86-935a-1fd9b8b6b996 req-7a2948c3-0cdf-4a8e-a681-b8c994889763 tempest-TestMinimumBasicScenario-81492806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-fe3e78ea-b1b9-4a86-935a-1fd9b8b6b996 req-7a2948c3-0cdf-4a8e-a681-b8c994889763 tempest-TestMinimumBasicScenario-81492806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-fe3e78ea-b1b9-4a86-935a-1fd9b8b6b996 req-7a2948c3-0cdf-4a8e-a681-b8c994889763 tempest-TestMinimumBasicScenario-81492806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-1329b3da-a847-44fb-a18d-9054cb772d43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ae0d842-ae5c-48c3-bc45-3fce786fabc4', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:38:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-fe3e78ea-b1b9-4a86-935a-1fd9b8b6b996 req-7a2948c3-0cdf-4a8e-a681-b8c994889763 tempest-TestMinimumBasicScenario-81492806 None] attachment_update completed successfully. Jul 30 16:38:43 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=32,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:38:43 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:47 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:38:47 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:47 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.453s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:38:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:38:50 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Flow 'volume_create_manager' (fff8d167-3f34-40de-9681-19a0eed09de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453951ea-ad2c-4f17-b758-aff49ce4d755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453951ea-ad2c-4f17-b758-aff49ce4d755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7749a39-8616-4273-9fcf-793232313fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f32229e1be6488bb7272def9127a552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:51Z,use_quota=True,user_id='04ef857c64f14f328d6d7d251adc054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4145f1f3-e083-4915-b611-ab56d6d7d15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4145f1f3-e083-4915-b611-ab56d6d7d15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86476fa-011f-4da1-b807-5d534e69f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86476fa-011f-4da1-b807-5d534e69f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7749a39-8616-4273-9fcf-793232313fc1', 'volume_name': 'volume-d7749a39-8616-4273-9fcf-793232313fc1', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2a4bac-95ad-4a5d-9aa7-d44e6eb315db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2a4bac-95ad-4a5d-9aa7-d44e6eb315db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e36195-e60b-4333-ae02-5acb3ce03f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Volume d7749a39-8616-4273-9fcf-793232313fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7749a39-8616-4273-9fcf-793232313fc1', 'volume_size': 1} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7749a39-8616-4273-9fcf-793232313fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f32229e1be6488bb7272def9127a552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:51Z,use_quota=True,user_id='04ef857c64f14f328d6d7d251adc054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Creating volume d7749a39-8616-4273-9fcf-793232313fc1 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:51 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:51 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 1073741824 Jul 30 16:38:51 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:51 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 1073741824" returned: 0 in 0.450s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:51 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 Jul 30 16:38:51 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:51 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1" returned: 0 in 0.246s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e36195-e60b-4333-ae02-5acb3ce03f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7749a39-8616-4273-9fcf-793232313fc1', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf76f9d7-3631-477b-80ba-c542cca28414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Volume volume-d7749a39-8616-4273-9fcf-793232313fc1 (d7749a39-8616-4273-9fcf-793232313fc1): created successfully Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf76f9d7-3631-477b-80ba-c542cca28414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Flow 'volume_create_manager' (fff8d167-3f34-40de-9681-19a0eed09de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c7c385d5-e90e-4abb-a433-20273082c9d9 tempest-CinderUnicodeTest-93666949 None] Created volume successfully. Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Flow 'volume_create_manager' (97d43728-b278-47f0-8371-6ff9f2e766c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9acf531-1334-4ca2-86a0-f736c9e483a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9acf531-1334-4ca2-86a0-f736c9e483a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1465016259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a7d1f6d-5012-4f32-b039-907ebf025dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f32229e1be6488bb7272def9127a552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:53Z,use_quota=True,user_id='04ef857c64f14f328d6d7d251adc054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895d67c5-ace2-4afd-945f-08094974fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895d67c5-ace2-4afd-945f-08094974fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c02b2a-567f-437b-a901-c76de003799c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c02b2a-567f-437b-a901-c76de003799c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a7d1f6d-5012-4f32-b039-907ebf025dd7', 'volume_name': 'volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d3a551-f6e1-4ed4-967b-c5f7a7eb1336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d3a551-f6e1-4ed4-967b-c5f7a7eb1336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5b29b5-a824-4579-9198-61e86bbc5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:52 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Volume 4a7d1f6d-5012-4f32-b039-907ebf025dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7', 'volume_size': 1} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1465016259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a7d1f6d-5012-4f32-b039-907ebf025dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f32229e1be6488bb7272def9127a552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:53Z,use_quota=True,user_id='04ef857c64f14f328d6d7d251adc054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Creating volume 4a7d1f6d-5012-4f32-b039-907ebf025dd7 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:52 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:38:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:52 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 1073741824 Jul 30 16:38:52 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:53 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 1073741824" returned: 0 in 0.430s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:53 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 Jul 30 16:38:53 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:53 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7" returned: 0 in 0.255s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5b29b5-a824-4579-9198-61e86bbc5821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2058f64-8616-410c-9dc6-c46353d882a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Volume volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 (4a7d1f6d-5012-4f32-b039-907ebf025dd7): created successfully Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2058f64-8616-410c-9dc6-c46353d882a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Flow 'volume_create_manager' (97d43728-b278-47f0-8371-6ff9f2e766c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:53 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c0feadb5-c30e-4697-ab25-ded6fe0baa21 tempest-CinderUnicodeTest-93666949 None] Created volume successfully. Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Creating offline snapshot b68b8165-787d-47e8-aad9-b387fc13b76b of volume 4a7d1f6d-5012-4f32-b039-907ebf025dd7 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fc9190-2017-4fc9-b661-dd6b4e0104d6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:55 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 Jul 30 16:38:55 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:55 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7" returned: 0 in 0.377s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:55 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b 1G Jul 30 16:38:55 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:55 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b 1G" returned: 0 in 0.381s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:55 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b Jul 30 16:38:55 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:56 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b" returned: 0 in 0.274s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:56 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b is being set with open permissions: ugo+rw Jul 30 16:38:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:56 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b Jul 30 16:38:56 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:56 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b" returned: 0 in 0.266s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:56 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.info Jul 30 16:38:56 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:56 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.info" returned: 0 in 0.270s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:56 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.info is being set with open permissions: ugo+rw Jul 30 16:38:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:56 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.info Jul 30 16:38:56 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:56 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.info" returned: 0 in 0.253s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:57 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c565c0c8-6a78-41dc-a9e3-f732eef44df4 tempest-CinderUnicodeTest-93666949 None] Create snapshot completed successfully Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Acquiring lock "cinder-b68b8165-787d-47e8-aad9-b387fc13b76b-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Lock "cinder-b68b8165-787d-47e8-aad9-b387fc13b76b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Acquiring lock "cinder-quobyte-4a7d1f6d-5012-4f32-b039-907ebf025dd7" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Lock "cinder-quobyte-4a7d1f6d-5012-4f32-b039-907ebf025dd7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Acquiring lock "cinder-quobyte-b68b8165-787d-47e8-aad9-b387fc13b76b" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Lock "cinder-quobyte-b68b8165-787d-47e8-aad9-b387fc13b76b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Deleting offline snapshot b68b8165-787d-47e8-aad9-b387fc13b76b of volume 4a7d1f6d-5012-4f32-b039-907ebf025dd7 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] snapshot_file for this snap is: volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[157f1e71-194f-47e1-9ab3-75717df7a2e3]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Flow 'volume_create_manager' (e9ff73dc-3983-4bf2-be2d-05b57f70eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486bbe0f-e550-4506-a466-99e8a0e59092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486bbe0f-e550-4506-a466-99e8a0e59092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-210234295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c143d1-b369-424f-8281-5e8748663790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db46884878254db98dbe371c08b3f566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:57Z,use_quota=True,user_id='f8de7820b9d34c8e8ca19ae551122413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714ef6eb-18d2-4b51-ad13-77d0ef2a8b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714ef6eb-18d2-4b51-ad13-77d0ef2a8b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bc756d-db97-4463-bb77-f6b235bc7ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bc756d-db97-4463-bb77-f6b235bc7ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c143d1-b369-424f-8281-5e8748663790', 'volume_name': 'volume-73c143d1-b369-424f-8281-5e8748663790', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67fccc95-94f5-47ea-9a59-ef58c9ac0741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:57 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67fccc95-94f5-47ea-9a59-ef58c9ac0741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:57 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb2d514-a090-41dc-a0e5-623b51730e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:57 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Volume 73c143d1-b369-424f-8281-5e8748663790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c143d1-b369-424f-8281-5e8748663790', 'volume_size': 1} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-210234295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c143d1-b369-424f-8281-5e8748663790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db46884878254db98dbe371c08b3f566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:57Z,use_quota=True,user_id='f8de7820b9d34c8e8ca19ae551122413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Creating volume 73c143d1-b369-424f-8281-5e8748663790 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:57 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:57 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 1073741824 Jul 30 16:38:57 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:57 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b" returned: 0 in 0.351s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697ef75-1219-4017-a6ce-7f75e9fdb0e6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:57 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 Jul 30 16:38:57 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:57 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 1073741824" returned: 0 in 0.463s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:58 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 Jul 30 16:38:58 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:58 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:58 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b Jul 30 16:38:58 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:58 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790" returned: 0 in 0.245s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb2d514-a090-41dc-a0e5-623b51730e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c143d1-b369-424f-8281-5e8748663790', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c208947-93c9-42c1-a1ff-d8ab31ee267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:58 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Volume volume-73c143d1-b369-424f-8281-5e8748663790 (73c143d1-b369-424f-8281-5e8748663790): created successfully Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c208947-93c9-42c1-a1ff-d8ab31ee267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Flow 'volume_create_manager' (e9ff73dc-3983-4bf2-be2d-05b57f70eff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fb4f0e97-69ed-4cef-8eae-833c68c38a64 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Created volume successfully. Jul 30 16:38:58 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b" returned: 0 in 0.331s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:58 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b Jul 30 16:38:58 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:58 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7.b68b8165-787d-47e8-aad9-b387fc13b76b" returned: 0 in 0.234s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Lock "cinder-quobyte-b68b8165-787d-47e8-aad9-b387fc13b76b" released by "_delete_snapshot" :: held 1.406s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Lock "cinder-quobyte-4a7d1f6d-5012-4f32-b039-907ebf025dd7" released by "delete_snapshot" :: held 1.433s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Created reservations ['5196ae88-f30d-428d-b9f8-82d61b08cb4b', 'f5909427-ed1c-4f3c-ac5e-b6652b3deb45', 'a317b22e-7aad-4150-947b-ecb16ba58e4b', '4f6ee550-14e8-45a0-aa43-33a59fd89792'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Delete snapshot completed successfully. Jul 30 16:38:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-09295250-d5a3-469f-8d54-62b5e007c812 tempest-CinderUnicodeTest-93666949 None] Lock "cinder-b68b8165-787d-47e8-aad9-b387fc13b76b-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Acquiring lock "cinder-4a7d1f6d-5012-4f32-b039-907ebf025dd7-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Lock "cinder-4a7d1f6d-5012-4f32-b039-907ebf025dd7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Acquiring lock "cinder-quobyte-4a7d1f6d-5012-4f32-b039-907ebf025dd7" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Lock "cinder-quobyte-4a7d1f6d-5012-4f32-b039-907ebf025dd7" acquired by "delete_volume" :: waited 0.031s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:59 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c582019e-e5fe-4209-b9e8-30fdc8882897]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:59 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 Jul 30 16:38:59 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:00 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7" returned: 0 in 0.569s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:00 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7 Jul 30 16:39:00 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2bb86619-a401-43ad-9512-abc666c66a4a req-f623f675-9b03-469e-b971-988b9a55509d tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2bb86619-a401-43ad-9512-abc666c66a4a req-f623f675-9b03-469e-b971-988b9a55509d tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2bb86619-a401-43ad-9512-abc666c66a4a req-f623f675-9b03-469e-b971-988b9a55509d tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-2bb86619-a401-43ad-9512-abc666c66a4a req-f623f675-9b03-469e-b971-988b9a55509d tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-73c143d1-b369-424f-8281-5e8748663790', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '270a7d1d-e989-4dc9-8829-811b18a1cb92', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:39:00 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4a7d1f6d-5012-4f32-b039-907ebf025dd7" returned: 0 in 0.279s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Lock "cinder-quobyte-4a7d1f6d-5012-4f32-b039-907ebf025dd7" released by "delete_volume" :: held 0.961s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-2bb86619-a401-43ad-9512-abc666c66a4a req-f623f675-9b03-469e-b971-988b9a55509d tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] attachment_update completed successfully. Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Created reservations ['9f3c244a-6a80-4138-bd21-fffff6ab1c37', '1125288e-6fcc-4aa9-a80b-1898536a077c', '92aaff6d-63c3-460f-8897-8c86b6e4f6e5', 'e692a32b-6608-4c9e-9f5c-2426c77b1623'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:00 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:00 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:00 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.265s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Deleted volume successfully. Jul 30 16:39:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8a066099-cb11-4a10-8e91-4f93aa358b3d tempest-CinderUnicodeTest-93666949 None] Lock "cinder-4a7d1f6d-5012-4f32-b039-907ebf025dd7-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Acquiring lock "cinder-d7749a39-8616-4273-9fcf-793232313fc1-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Lock "cinder-d7749a39-8616-4273-9fcf-793232313fc1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Acquiring lock "cinder-quobyte-d7749a39-8616-4273-9fcf-793232313fc1" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Lock "cinder-quobyte-d7749a39-8616-4273-9fcf-793232313fc1" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9444036-50d5-4764-89ea-f843d047f1c8]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:01 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 Jul 30 16:39:01 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:02 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:02 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1 Jul 30 16:39:02 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:02 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d7749a39-8616-4273-9fcf-793232313fc1" returned: 0 in 0.259s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Lock "cinder-quobyte-d7749a39-8616-4273-9fcf-793232313fc1" released by "delete_volume" :: held 0.699s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Created reservations ['4f76eb1b-53e8-4d58-b7e2-709adf483b46', 'd005a176-e283-498c-9308-a04f952613f8', '2a6bf3b3-3585-46bb-a8c1-517aaa823ef9', 'f6ed1532-3a2c-46c8-aa47-7d80e686f324'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:02 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:02 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:02 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.257s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Deleted volume successfully. Jul 30 16:39:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9d9bb555-59d1-4017-bc03-62fe0fd9e06c tempest-CinderUnicodeTest-93666949 None] Lock "cinder-d7749a39-8616-4273-9fcf-793232313fc1-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-3a36aabb-71cb-4e4f-8e4e-7e914babd43b req-e8b23361-3da2-41b9-a122-e8c3b7423796 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Terminate volume connection completed successfully. Jul 30 16:39:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-3a36aabb-71cb-4e4f-8e4e-7e914babd43b req-e8b23361-3da2-41b9-a122-e8c3b7423796 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Deleting attachment 270a7d1d-e989-4dc9-8829-811b18a1cb92. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:39:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Acquiring lock "cinder-73c143d1-b369-424f-8281-5e8748663790-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "cinder-73c143d1-b369-424f-8281-5e8748663790-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Acquiring lock "cinder-quobyte-73c143d1-b369-424f-8281-5e8748663790" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "cinder-quobyte-73c143d1-b369-424f-8281-5e8748663790" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e835d55e-e606-48a2-b990-9178686a7052]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:05 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 Jul 30 16:39:05 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:05 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790" returned: 0 in 0.473s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:05 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790 Jul 30 16:39:05 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:05 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73c143d1-b369-424f-8281-5e8748663790" returned: 0 in 0.305s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "cinder-quobyte-73c143d1-b369-424f-8281-5e8748663790" released by "delete_volume" :: held 0.832s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:05 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Created reservations ['e2f6cffc-6fa0-4f55-b037-392841ddaf7d', 'a1109026-62c2-44e9-bd33-5e43c755663c', '4b632a89-1f00-4acd-918c-9ed4252d47b1', '99d44b58-7524-423e-a3b7-138547fa5559'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:06 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:06 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:06 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.488s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:06 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Deleted volume successfully. Jul 30 16:39:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0d35200b-f152-4149-9537-f250bd2ead89 tempest-TestServerVolumeAttachScenarioOldVersion-2125691419 None] Lock "cinder-73c143d1-b369-424f-8281-5e8748663790-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Flow 'volume_create_manager' (4fab358f-04b3-4715-b4ad-8f9a1da02d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d23feb-698e-493a-ae96-539d7725eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d23feb-698e-493a-ae96-539d7725eb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-39444060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04efe89-2b5f-4a6f-9a3f-b68356898ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f67128549f4dd08cb177f8025fa595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:07Z,use_quota=True,user_id='6fc6f2de2f0149d391bfa10af1102389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195357bc-8ac8-4356-bf61-321e612e88f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195357bc-8ac8-4356-bf61-321e612e88f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0205a911-486a-4864-8dba-06bd755584c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0205a911-486a-4864-8dba-06bd755584c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04efe89-2b5f-4a6f-9a3f-b68356898ca5', 'volume_name': 'volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f212e33-100b-4d38-8e5f-3618e175c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f212e33-100b-4d38-8e5f-3618e175c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d54cc8d-ca62-4c65-a8b5-629b6802055a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:07 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Volume e04efe89-2b5f-4a6f-9a3f-b68356898ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5', 'volume_size': 1} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-39444060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04efe89-2b5f-4a6f-9a3f-b68356898ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f67128549f4dd08cb177f8025fa595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:07Z,use_quota=True,user_id='6fc6f2de2f0149d391bfa10af1102389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Creating volume e04efe89-2b5f-4a6f-9a3f-b68356898ca5 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:07 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:07 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 1073741824 Jul 30 16:39:07 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:08 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 1073741824" returned: 0 in 0.925s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Flow 'volume_create_manager' (59af45b4-8721-4a39-a370-e8b811c5d570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf6740b-4fb8-49dd-ae41-0d556af1fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf6740b-4fb8-49dd-ae41-0d556af1fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079304029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7258f027-f46d-4ae1-9173-f404f94f615f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4d4fa2e0524842994d6719400eab26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:08Z,use_quota=True,user_id='dac3d1d9c9e84269bb9ef9e80256bb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc0bd0d-14c7-4a0e-8ad7-baabf084096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc0bd0d-14c7-4a0e-8ad7-baabf084096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0095bf68-be1a-4b68-a38c-2ce076b5f429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0095bf68-be1a-4b68-a38c-2ce076b5f429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7258f027-f46d-4ae1-9173-f404f94f615f', 'volume_name': 'volume-7258f027-f46d-4ae1-9173-f404f94f615f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35da2676-fd8d-424f-9145-7df027626573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35da2676-fd8d-424f-9145-7df027626573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c44ae9-3660-4048-a1fb-097eb3a0c7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:08 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Volume 7258f027-f46d-4ae1-9173-f404f94f615f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7258f027-f46d-4ae1-9173-f404f94f615f', 'volume_size': 1} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:08 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 Jul 30 16:39:08 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:08 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5" returned: 0 in 0.314s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079304029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7258f027-f46d-4ae1-9173-f404f94f615f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4d4fa2e0524842994d6719400eab26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:08Z,use_quota=True,user_id='dac3d1d9c9e84269bb9ef9e80256bb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Creating volume 7258f027-f46d-4ae1-9173-f404f94f615f {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:09 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d54cc8d-ca62-4c65-a8b5-629b6802055a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c4439d-ba5f-4155-a61f-9506205ee349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:09 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f 1073741824 Jul 30 16:39:09 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:09 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Volume volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 (e04efe89-2b5f-4a6f-9a3f-b68356898ca5): created successfully Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c4439d-ba5f-4155-a61f-9506205ee349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Flow 'volume_create_manager' (4fab358f-04b3-4715-b4ad-8f9a1da02d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8cc216d6-8b29-4e9d-8b0b-213474e30aa0 tempest-AttachVolumeNegativeTest-2093205215 None] Created volume successfully. Jul 30 16:39:09 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f 1073741824" returned: 0 in 0.672s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:09 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f Jul 30 16:39:09 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:10 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c44ae9-3660-4048-a1fb-097eb3a0c7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7258f027-f46d-4ae1-9173-f404f94f615f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306d5242-442d-4888-8ccf-595578d8956b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:10 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Volume volume-7258f027-f46d-4ae1-9173-f404f94f615f (7258f027-f46d-4ae1-9173-f404f94f615f): created successfully Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306d5242-442d-4888-8ccf-595578d8956b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Flow 'volume_create_manager' (59af45b4-8721-4a39-a370-e8b811c5d570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ee11303d-212b-404a-b43c-341337160635 tempest-ProjectReaderTests-1028971481 None] Created volume successfully. Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-cd0694d1-0b35-4bce-9a24-4f4051243b91 req-142f720e-e7d5-45ca-bd49-9244e7c182a2 tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-cd0694d1-0b35-4bce-9a24-4f4051243b91 req-142f720e-e7d5-45ca-bd49-9244e7c182a2 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-cd0694d1-0b35-4bce-9a24-4f4051243b91 req-142f720e-e7d5-45ca-bd49-9244e7c182a2 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-cd0694d1-0b35-4bce-9a24-4f4051243b91 req-142f720e-e7d5-45ca-bd49-9244e7c182a2 tempest-AttachVolumeNegativeTest-2093205215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53cccebd-5bef-4221-ae38-8df0cd539a58', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:39:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-cd0694d1-0b35-4bce-9a24-4f4051243b91 req-142f720e-e7d5-45ca-bd49-9244e7c182a2 tempest-AttachVolumeNegativeTest-2093205215 None] attachment_update completed successfully. Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Acquiring lock "cinder-7258f027-f46d-4ae1-9173-f404f94f615f-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Lock "cinder-7258f027-f46d-4ae1-9173-f404f94f615f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Acquiring lock "cinder-quobyte-7258f027-f46d-4ae1-9173-f404f94f615f" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Lock "cinder-quobyte-7258f027-f46d-4ae1-9173-f404f94f615f" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cda7c0-b0a5-4548-9ece-6400737ed979]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:11 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f Jul 30 16:39:11 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:11 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f" returned: 0 in 0.563s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:11 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f Jul 30 16:39:11 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:11 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7258f027-f46d-4ae1-9173-f404f94f615f" returned: 0 in 0.298s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Lock "cinder-quobyte-7258f027-f46d-4ae1-9173-f404f94f615f" released by "delete_volume" :: held 0.914s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:11 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Created reservations ['ba109cbc-10cc-43b4-b11a-f0a876b1bf7d', '8bbb5bec-524d-4d2e-87fa-da9f98b94db8', '8ee6e406-e8a7-4476-858b-b6c80bea3fb9', 'cb0b2900-c67c-4dce-809d-0bedaf991bc2'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:12 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:12 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:12 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.271s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:12 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:12 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Deleted volume successfully. Jul 30 16:39:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-da461a06-b9ab-4eb2-8401-39dd60f04df4 tempest-ProjectReaderTests-1028971481 None] Lock "cinder-7258f027-f46d-4ae1-9173-f404f94f615f-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Flow 'volume_create_manager' (7e60b249-fadb-4608-b3d9-51194f893ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8f1d42-00dd-4554-9f98-8eb156006538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8f1d42-00dd-4554-9f98-8eb156006538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205932272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec09319-c3ad-4cf4-afca-b905f9901d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4d4fa2e0524842994d6719400eab26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:14Z,use_quota=True,user_id='dac3d1d9c9e84269bb9ef9e80256bb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06c321f-c8e4-4919-a606-c0a38923cf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06c321f-c8e4-4919-a606-c0a38923cf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987b90f0-c4da-4883-a75e-561aa769e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987b90f0-c4da-4883-a75e-561aa769e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec09319-c3ad-4cf4-afca-b905f9901d72', 'volume_name': 'volume-6ec09319-c3ad-4cf4-afca-b905f9901d72', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1398e811-1469-4965-893e-8b732b30e98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1398e811-1469-4965-893e-8b732b30e98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7e7aea-2489-4539-8dbb-538da5644c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:14 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Volume 6ec09319-c3ad-4cf4-afca-b905f9901d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec09319-c3ad-4cf4-afca-b905f9901d72', 'volume_size': 1} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205932272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec09319-c3ad-4cf4-afca-b905f9901d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4d4fa2e0524842994d6719400eab26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:14Z,use_quota=True,user_id='dac3d1d9c9e84269bb9ef9e80256bb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Creating volume 6ec09319-c3ad-4cf4-afca-b905f9901d72 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:14 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:14 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 1073741824 Jul 30 16:39:14 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:14 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 1073741824" returned: 0 in 0.694s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:14 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 Jul 30 16:39:14 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:15 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72" returned: 0 in 0.483s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7e7aea-2489-4539-8dbb-538da5644c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec09319-c3ad-4cf4-afca-b905f9901d72', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475c5c5d-bc47-4c63-9ee9-ce736be6a24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:15 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Volume volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 (6ec09319-c3ad-4cf4-afca-b905f9901d72): created successfully Jul 30 16:39:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475c5c5d-bc47-4c63-9ee9-ce736be6a24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:15 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Flow 'volume_create_manager' (7e60b249-fadb-4608-b3d9-51194f893ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-46d8e7f7-8a8b-47f9-bc3b-2b50738e3a1c tempest-ProjectReaderTests-1028971481 None] Created volume successfully. Jul 30 16:39:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Acquiring lock "cinder-6ec09319-c3ad-4cf4-afca-b905f9901d72-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Lock "cinder-6ec09319-c3ad-4cf4-afca-b905f9901d72-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Acquiring lock "cinder-quobyte-6ec09319-c3ad-4cf4-afca-b905f9901d72" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Lock "cinder-quobyte-6ec09319-c3ad-4cf4-afca-b905f9901d72" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:16 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1b52c6-0707-48a7-bf81-4e05f3b92a5b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:16 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 Jul 30 16:39:16 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:16 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72" returned: 0 in 0.705s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:16 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72 Jul 30 16:39:16 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:17 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6ec09319-c3ad-4cf4-afca-b905f9901d72" returned: 0 in 0.377s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Lock "cinder-quobyte-6ec09319-c3ad-4cf4-afca-b905f9901d72" released by "delete_volume" :: held 1.137s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Created reservations ['af63f7fc-46ae-4933-88f4-8ea93f41e45a', '843828f0-2087-4d18-bb4f-84bcdbe3ade5', 'e76cd2c1-6cd1-41d7-abda-4fd2d9056ee9', 'd9bfcb64-e9a3-463b-9cb6-8d1568b75963'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:17 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:17 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:17 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.483s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:17 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:18 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Deleted volume successfully. Jul 30 16:39:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b2756dab-9c90-4f34-a65c-023d54f28050 tempest-ProjectReaderTests-1028971481 None] Lock "cinder-6ec09319-c3ad-4cf4-afca-b905f9901d72-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:27 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=59,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=5 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:39:28 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=62,cinder:SELECT=62,cinder:INSERT=15,cinder:DELETE=7 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (85c94925-a921-4b1e-8f7e-5e4ba0804312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3873c1b3-465c-49c6-a4ae-d5f0db19cb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3873c1b3-465c-49c6-a4ae-d5f0db19cb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-933843985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251863e3-54a3-400f-94d6-6447072b62c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:29Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca7c664-7862-43ff-8b14-8ceeb209a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca7c664-7862-43ff-8b14-8ceeb209a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da62df6b-0335-4bc2-9673-77b3d0563a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da62df6b-0335-4bc2-9673-77b3d0563a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251863e3-54a3-400f-94d6-6447072b62c3', 'volume_name': 'volume-251863e3-54a3-400f-94d6-6447072b62c3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c34c6e-1a17-47cb-b3fb-2dd97c9eb45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c34c6e-1a17-47cb-b3fb-2dd97c9eb45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f48323f-0953-4f7d-b7f3-3607868c624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:29 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume 251863e3-54a3-400f-94d6-6447072b62c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251863e3-54a3-400f-94d6-6447072b62c3', 'volume_size': 1} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-933843985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251863e3-54a3-400f-94d6-6447072b62c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:29Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Creating volume 251863e3-54a3-400f-94d6-6447072b62c3 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:29 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:29 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 1073741824 Jul 30 16:39:29 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:30 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 1073741824" returned: 0 in 0.842s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:30 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 Jul 30 16:39:30 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:30 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3" returned: 0 in 0.397s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f48323f-0953-4f7d-b7f3-3607868c624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251863e3-54a3-400f-94d6-6447072b62c3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f3a925-836e-45ed-8888-9ec44245cea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume volume-251863e3-54a3-400f-94d6-6447072b62c3 (251863e3-54a3-400f-94d6-6447072b62c3): created successfully Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f3a925-836e-45ed-8888-9ec44245cea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (85c94925-a921-4b1e-8f7e-5e4ba0804312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4ec5cff1-ac82-4acd-bf97-96c3c055f012 tempest-CreateVolumesFromSnapshotTest-899703954 None] Created volume successfully. Jul 30 16:39:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Creating offline snapshot 630321d1-a024-449d-9b64-adab9e1f98d1 of volume 251863e3-54a3-400f-94d6-6447072b62c3 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:39:31 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8662389b-7e15-4428-8a81-70977f4b198d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:31 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 Jul 30 16:39:31 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:31 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3" returned: 0 in 0.400s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:32 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 1G Jul 30 16:39:32 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:32 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 1G" returned: 0 in 0.541s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251863e3-54a3-400f-94d6-6447072b62c3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:32 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251863e3-54a3-400f-94d6-6447072b62c3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 Jul 30 16:39:32 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:32 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251863e3-54a3-400f-94d6-6447072b62c3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1" returned: 0 in 0.328s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:32 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 is being set with open permissions: ugo+rw Jul 30 16:39:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:32 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 Jul 30 16:39:32 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:33 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:33 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.info Jul 30 16:39:33 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:33 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.info" returned: 0 in 0.321s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:33 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.info is being set with open permissions: ugo+rw Jul 30 16:39:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:33 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.info Jul 30 16:39:33 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:33 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.info" returned: 0 in 0.302s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-57984a30-f328-4438-8f65-82fb6041ac77 tempest-CreateVolumesFromSnapshotTest-899703954 None] Create snapshot completed successfully Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (21477dd6-40e3-438e-82e9-a2a5918e8ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5364fb24-d41b-42c2-a2dc-29960a806677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5364fb24-d41b-42c2-a2dc-29960a806677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934662183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4d8689-e7d7-4ff0-8862-fd19af85afd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:36Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7a64ce-882a-4b55-9397-b49ab43d014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7a64ce-882a-4b55-9397-b49ab43d014a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0062b84b-546a-4838-bed3-0066bdecedcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0062b84b-546a-4838-bed3-0066bdecedcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4d8689-e7d7-4ff0-8862-fd19af85afd0', 'volume_name': 'volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f599b49b-bf55-47d8-8970-e7513f13424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f599b49b-bf55-47d8-8970-e7513f13424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aab470-fa74-4d9e-92ba-73d72da7dd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume 5a4d8689-e7d7-4ff0-8862-fd19af85afd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0', 'volume_size': 1} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934662183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4d8689-e7d7-4ff0-8862-fd19af85afd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:36Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Creating volume 5a4d8689-e7d7-4ff0-8862-fd19af85afd0 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:35 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:35 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 1073741824 Jul 30 16:39:36 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (ebc14a92-0423-45e1-9965-f905dde49cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db795737-2710-4ab9-bc9c-047ecf4bddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db795737-2710-4ab9-bc9c-047ecf4bddbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528925339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36519cf4-4507-4fe9-9a8c-87cd25615fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:36Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c71435-302f-4977-86d6-452ed7a89f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c71435-302f-4977-86d6-452ed7a89f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10e3223-76a0-4235-9c26-aaa5bbeb3dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10e3223-76a0-4235-9c26-aaa5bbeb3dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36519cf4-4507-4fe9-9a8c-87cd25615fb5', 'volume_name': 'volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf7022e-974c-462b-8b87-3eed71b3c017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf7022e-974c-462b-8b87-3eed71b3c017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432f4a6b-03d9-4e23-929b-164e397da15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:36 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume 36519cf4-4507-4fe9-9a8c-87cd25615fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5', 'volume_size': 1} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:36 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 1073741824" returned: 0 in 0.818s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:36 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 Jul 30 16:39:36 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:37 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0" returned: 0 in 0.406s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528925339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36519cf4-4507-4fe9-9a8c-87cd25615fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:36Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Creating volume 36519cf4-4507-4fe9-9a8c-87cd25615fb5 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:37 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:37 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 1073741824 Jul 30 16:39:37 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aab470-fa74-4d9e-92ba-73d72da7dd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc21571-c80d-49af-aa54-a5eb5a2f9fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:37 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 (5a4d8689-e7d7-4ff0-8862-fd19af85afd0): created successfully Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc21571-c80d-49af-aa54-a5eb5a2f9fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (21477dd6-40e3-438e-82e9-a2a5918e8ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (253a67f0-6f27-4e86-8750-761a4dd7a071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c490fc-a6de-4af3-bfe2-c4a85c623c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ff4bb7a1-ac01-44ab-9c35-bf31e0b1df63 tempest-CreateVolumesFromSnapshotTest-899703954 None] Created volume successfully. Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c490fc-a6de-4af3-bfe2-c4a85c623c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1489870104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1a70a3-515c-4236-8b4e-3d793b8e6a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:37Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad084fb-ff86-45c0-a1e0-8eca8669c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad084fb-ff86-45c0-a1e0-8eca8669c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b941ddd-181c-4de2-a562-77878e24cfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b941ddd-181c-4de2-a562-77878e24cfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1a70a3-515c-4236-8b4e-3d793b8e6a22', 'volume_name': 'volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2693614-c4f5-4605-affe-709eeaea1537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2693614-c4f5-4605-affe-709eeaea1537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c637c75c-b15e-403a-9a17-5595e2adc25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:37 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume cb1a70a3-515c-4236-8b4e-3d793b8e6a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22', 'volume_size': 1} Jul 30 16:39:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (0c7c0ce8-ddcd-4b06-981e-b14af547e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493a2725-dd1d-4389-bc99-f468499143f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493a2725-dd1d-4389-bc99-f468499143f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1134188771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e61b5b7-44d2-427f-9666-2fe698ac8ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:38Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4038f8d3-4209-4975-9c85-86cbd84d9286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4038f8d3-4209-4975-9c85-86cbd84d9286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c166564d-f553-4870-8170-68eff30c86e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c166564d-f553-4870-8170-68eff30c86e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e61b5b7-44d2-427f-9666-2fe698ac8ebd', 'volume_name': 'volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d8abeb-8754-4705-ba49-1891daae9e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d8abeb-8754-4705-ba49-1891daae9e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d12bc1-8b83-459c-815a-251d6479402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume 2e61b5b7-44d2-427f-9666-2fe698ac8ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd', 'volume_size': 1} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:38 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 1073741824" returned: 0 in 0.872s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:38 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 Jul 30 16:39:38 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:38 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (e4a44a87-7605-48e9-986b-8b3bffaee291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588e4f3d-bd14-4c2b-b1f4-da4e3d9dc050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5" returned: 0 in 0.508s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1489870104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1a70a3-515c-4236-8b4e-3d793b8e6a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:37Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Creating volume cb1a70a3-515c-4236-8b4e-3d793b8e6a22 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:38 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588e4f3d-bd14-4c2b-b1f4-da4e3d9dc050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070169820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f0430e-eff4-40fc-8fb4-22e69ff8884f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:39Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80231f97-fc11-4842-b0f2-03499909498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80231f97-fc11-4842-b0f2-03499909498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 1073741824 Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75209a48-e780-492b-bba3-eb019d8aefc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75209a48-e780-492b-bba3-eb019d8aefc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f0430e-eff4-40fc-8fb4-22e69ff8884f', 'volume_name': 'volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e227e71-6623-45dd-8bd5-89eb4af83c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e227e71-6623-45dd-8bd5-89eb4af83c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf6b3b8-f19d-419d-a650-c58400089aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume 73f0430e-eff4-40fc-8fb4-22e69ff8884f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f', 'volume_size': 1} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432f4a6b-03d9-4e23-929b-164e397da15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e191602-6246-4d48-bce9-aad792e993f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:38 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 (36519cf4-4507-4fe9-9a8c-87cd25615fb5): created successfully Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e191602-6246-4d48-bce9-aad792e993f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (ebc14a92-0423-45e1-9965-f905dde49cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8f2d6ce2-37e0-49cc-8348-0f671ace94bd tempest-CreateVolumesFromSnapshotTest-899703954 None] Created volume successfully. Jul 30 16:39:39 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 1073741824" returned: 0 in 0.548s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:39 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 Jul 30 16:39:39 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:39 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1134188771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e61b5b7-44d2-427f-9666-2fe698ac8ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:38Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Creating volume 2e61b5b7-44d2-427f-9666-2fe698ac8ebd {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:39 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c637c75c-b15e-403a-9a17-5595e2adc25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d249b865-623d-4dd9-ac50-8ec6d450ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:39 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd 1073741824 Jul 30 16:39:39 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:39 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 (cb1a70a3-515c-4236-8b4e-3d793b8e6a22): created successfully Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d249b865-623d-4dd9-ac50-8ec6d450ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (253a67f0-6f27-4e86-8750-761a4dd7a071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9e2f09cd-aac2-4760-a7dd-b770e25c74fc tempest-CreateVolumesFromSnapshotTest-899703954 None] Created volume successfully. Jul 30 16:39:40 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd 1073741824" returned: 0 in 0.502s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:40 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd Jul 30 16:39:40 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:40 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd" returned: 0 in 0.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070169820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f0430e-eff4-40fc-8fb4-22e69ff8884f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe78a9c0c204238ab0e8d8ccef8126d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:39Z,use_quota=True,user_id='52158eeaf51349bdbe7a9bea757a4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Creating volume 73f0430e-eff4-40fc-8fb4-22e69ff8884f {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:40 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:40 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f 1073741824 Jul 30 16:39:40 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d12bc1-8b83-459c-815a-251d6479402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed1adac-66f8-4c13-92b3-5809cf91ae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:40 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd (2e61b5b7-44d2-427f-9666-2fe698ac8ebd): created successfully Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed1adac-66f8-4c13-92b3-5809cf91ae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (0c7c0ce8-ddcd-4b06-981e-b14af547e9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:40 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b73d3b1c-06e0-44b7-bc20-dc7dbf7c87bf tempest-CreateVolumesFromSnapshotTest-899703954 None] Created volume successfully. Jul 30 16:39:41 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f 1073741824" returned: 0 in 0.508s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:41 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f Jul 30 16:39:41 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:41 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f" returned: 0 in 0.303s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf6b3b8-f19d-419d-a650-c58400089aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b606eedf-a3fb-4537-8700-080fc869de7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Volume volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f (73f0430e-eff4-40fc-8fb4-22e69ff8884f): created successfully Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b606eedf-a3fb-4537-8700-080fc869de7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Flow 'volume_create_manager' (e4a44a87-7605-48e9-986b-8b3bffaee291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:41 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0dfe1d72-d19c-4bfc-927b-218dcecd02a6 tempest-CreateVolumesFromSnapshotTest-899703954 None] Created volume successfully. Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-73f0430e-eff4-40fc-8fb4-22e69ff8884f-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-73f0430e-eff4-40fc-8fb4-22e69ff8884f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-quobyte-73f0430e-eff4-40fc-8fb4-22e69ff8884f" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-73f0430e-eff4-40fc-8fb4-22e69ff8884f" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2c5edc-5635-4fcb-a973-bbb10771e653]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:42 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f Jul 30 16:39:42 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:42 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f" returned: 0 in 0.391s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:42 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f Jul 30 16:39:42 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:42 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73f0430e-eff4-40fc-8fb4-22e69ff8884f" returned: 0 in 0.255s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-73f0430e-eff4-40fc-8fb4-22e69ff8884f" released by "delete_volume" :: held 0.690s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Created reservations ['185647db-42d3-41fb-8607-a59d38560a00', '02a881d5-5520-482f-bb81-9a19e6f5579e', 'bc4eddb4-e4f1-46e2-b57a-abdb71af6c6e', 'bcdf331b-b6dd-49a1-9af2-cfcd24d02978'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:43 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:43 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-2e61b5b7-44d2-427f-9666-2fe698ac8ebd-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-2e61b5b7-44d2-427f-9666-2fe698ac8ebd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-quobyte-2e61b5b7-44d2-427f-9666-2fe698ac8ebd" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:43 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.426s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-2e61b5b7-44d2-427f-9666-2fe698ac8ebd" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Deleted volume successfully. Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec3996-fe93-43d7-9627-246607b50ddd]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bbe11739-e0f0-4fd5-9269-7fff248918dd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-73f0430e-eff4-40fc-8fb4-22e69ff8884f-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:43 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd Jul 30 16:39:43 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:43 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd" returned: 0 in 0.445s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:43 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd Jul 30 16:39:43 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:44 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e61b5b7-44d2-427f-9666-2fe698ac8ebd" returned: 0 in 0.300s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-2e61b5b7-44d2-427f-9666-2fe698ac8ebd" released by "delete_volume" :: held 0.809s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Created reservations ['f95d6d58-87fe-4481-b7b8-18c0e684759d', 'f2646647-5dee-4eaf-9888-0f10b7c5f7c8', '9322ae65-ea62-4493-85ae-cb99256e805f', 'ef364c9b-5a2f-4915-a87e-6994f4a4582d'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:44 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:44 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-cb1a70a3-515c-4236-8b4e-3d793b8e6a22-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-cb1a70a3-515c-4236-8b4e-3d793b8e6a22-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-quobyte-cb1a70a3-515c-4236-8b4e-3d793b8e6a22" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-cb1a70a3-515c-4236-8b4e-3d793b8e6a22" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b122fe3-b822-41c5-ba80-3f3767b8035f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:44 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 Jul 30 16:39:44 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:44 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.419s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:44 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Deleted volume successfully. Jul 30 16:39:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ba762cb7-5e74-4e9c-b966-54571ebc8f3a tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-2e61b5b7-44d2-427f-9666-2fe698ac8ebd-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:45 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22" returned: 0 in 0.484s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:45 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22 Jul 30 16:39:45 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:45 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cb1a70a3-515c-4236-8b4e-3d793b8e6a22" returned: 0 in 0.345s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-cb1a70a3-515c-4236-8b4e-3d793b8e6a22" released by "delete_volume" :: held 0.883s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Created reservations ['d6ca174a-908f-40a7-9279-eb1eaf7a4aad', 'a134481f-50b4-4342-a58c-3d445919eb91', '0b198547-93ed-4451-a2cb-abe7b3967763', 'f6a9c2e9-b7ba-4cc5-8b33-6f033ca0b999'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-36519cf4-4507-4fe9-9a8c-87cd25615fb5-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:45 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:45 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-36519cf4-4507-4fe9-9a8c-87cd25615fb5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-quobyte-36519cf4-4507-4fe9-9a8c-87cd25615fb5" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-36519cf4-4507-4fe9-9a8c-87cd25615fb5" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a50799-12f0-4dc1-ab11-61638b313317]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:46 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:46 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 Jul 30 16:39:46 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Deleted volume successfully. Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7301d7bf-edd8-40c7-9525-903716c9e3af tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-cb1a70a3-515c-4236-8b4e-3d793b8e6a22-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:46 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5" returned: 0 in 0.568s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:46 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5 Jul 30 16:39:46 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:46 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-36519cf4-4507-4fe9-9a8c-87cd25615fb5" returned: 0 in 0.316s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-36519cf4-4507-4fe9-9a8c-87cd25615fb5" released by "delete_volume" :: held 0.954s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Created reservations ['28ca93c7-0794-421f-b50a-4fd4b86e347d', '2f1a8da8-c01b-431e-a86e-303b0a2d375b', '17318a2a-371c-4b9a-b4b7-77b9e209099b', 'de2ff3c7-08ac-4ac4-bf3d-232c04e961bf'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:47 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:47 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:47 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.333s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Deleted volume successfully. Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:47 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0a581250-84bb-4ad6-a517-8117c7acee35 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-36519cf4-4507-4fe9-9a8c-87cd25615fb5-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:47 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:47 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.295s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:39:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:39:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-5a4d8689-e7d7-4ff0-8862-fd19af85afd0-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-5a4d8689-e7d7-4ff0-8862-fd19af85afd0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-quobyte-5a4d8689-e7d7-4ff0-8862-fd19af85afd0" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-5a4d8689-e7d7-4ff0-8862-fd19af85afd0" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:48 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f16ba73-14b4-40ec-b012-768cb5b000b5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:48 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 Jul 30 16:39:48 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:48 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0" returned: 0 in 0.635s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:48 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0 Jul 30 16:39:48 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:49 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a4d8689-e7d7-4ff0-8862-fd19af85afd0" returned: 0 in 0.338s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-5a4d8689-e7d7-4ff0-8862-fd19af85afd0" released by "delete_volume" :: held 1.049s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Created reservations ['e90cbfb9-8666-4562-9fd0-57b82e604cdd', 'abd4a31d-aa9b-469f-a41e-b95401e639ec', 'd55e7e86-963a-4ad2-ae90-25542292cd96', 'baa3b342-ccd8-42b6-9038-7c733867a94d'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:49 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:49 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:49 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.310s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Deleted volume successfully. Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1d9a2bd5-5eed-47b8-891d-250e2ae3eddd tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-5a4d8689-e7d7-4ff0-8862-fd19af85afd0-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Flow 'volume_create_manager' (f2208937-c0ac-42e8-90aa-83132f04603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df04c70d-82b8-401f-ab5e-3c17b2279095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df04c70d-82b8-401f-ab5e-3c17b2279095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-21929648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d2e755-f560-4734-8df9-e36b5fadad6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053b9c35eeab446e83de0c6c9222a9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:50Z,use_quota=True,user_id='26d95ef7b206463ba0f94b8064782a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae3ec9c-77a1-4e2e-b2d4-a3196ebfd1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae3ec9c-77a1-4e2e-b2d4-a3196ebfd1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea31372-5665-4265-bf5e-04045bb99cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea31372-5665-4265-bf5e-04045bb99cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d2e755-f560-4734-8df9-e36b5fadad6c', 'volume_name': 'volume-e6d2e755-f560-4734-8df9-e36b5fadad6c', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ba4235-1406-4bd5-bbdc-db7c4f25596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ba4235-1406-4bd5-bbdc-db7c4f25596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f44de3-b31f-4db7-8d57-f33651e09997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:50 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Volume e6d2e755-f560-4734-8df9-e36b5fadad6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d2e755-f560-4734-8df9-e36b5fadad6c', 'volume_size': 1} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-21929648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d2e755-f560-4734-8df9-e36b5fadad6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053b9c35eeab446e83de0c6c9222a9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:50Z,use_quota=True,user_id='26d95ef7b206463ba0f94b8064782a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Creating volume e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:50 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:50 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c 1073741824 Jul 30 16:39:50 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-630321d1-a024-449d-9b64-adab9e1f98d1-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-630321d1-a024-449d-9b64-adab9e1f98d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-quobyte-251863e3-54a3-400f-94d6-6447072b62c3" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-251863e3-54a3-400f-94d6-6447072b62c3" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-quobyte-630321d1-a024-449d-9b64-adab9e1f98d1" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-630321d1-a024-449d-9b64-adab9e1f98d1" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Deleting offline snapshot 630321d1-a024-449d-9b64-adab9e1f98d1 of volume 251863e3-54a3-400f-94d6-6447072b62c3 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] snapshot_file for this snap is: volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a971f1dc-f918-4e32-abfb-79a676e03e0a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:50 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 Jul 30 16:39:50 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:50 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c 1073741824" returned: 0 in 0.884s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-f6b121e4-68ef-42d8-9f0d-0aaca0a4c77a req-92fc6567-d683-43f7-8151-10e453e424ce tempest-TestMinimumBasicScenario-81492806 None] Terminate volume connection completed successfully. Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-f6b121e4-68ef-42d8-9f0d-0aaca0a4c77a req-92fc6567-d683-43f7-8151-10e453e424ce tempest-TestMinimumBasicScenario-81492806 None] Deleting attachment 7ae0d842-ae5c-48c3-bc45-3fce786fabc4. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:39:51 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c Jul 30 16:39:51 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:51 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1" returned: 0 in 0.500s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-251863e3-54a3-400f-94d6-6447072b62c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24fb8c3-37ae-48ea-b198-12dbbaf75562]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:51 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 Jul 30 16:39:51 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:51 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c" returned: 0 in 0.423s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f44de3-b31f-4db7-8d57-f33651e09997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d2e755-f560-4734-8df9-e36b5fadad6c', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e451b88-cbac-4587-ba95-cc7e42dc63f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Volume volume-e6d2e755-f560-4734-8df9-e36b5fadad6c (e6d2e755-f560-4734-8df9-e36b5fadad6c): created successfully Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e451b88-cbac-4587-ba95-cc7e42dc63f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Flow 'volume_create_manager' (f2208937-c0ac-42e8-90aa-83132f04603d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3c003bf8-198d-4bad-8837-321ba5d65d2b tempest-SnapshotDependencyTests-327443766 None] Created volume successfully. Jul 30 16:39:51 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3" returned: 0 in 0.543s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:51 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 Jul 30 16:39:51 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Creating offline snapshot 9daa98fa-86f9-44d6-a590-788673ba88dd of volume e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d36fc9-8162-433d-afdd-43289bf39f68]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:52 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1" returned: 0 in 0.538s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:52 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1 Jul 30 16:39:52 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:52 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c Jul 30 16:39:52 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Acquiring lock "cinder-1329b3da-a847-44fb-a18d-9054cb772d43-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:52 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Lock "cinder-1329b3da-a847-44fb-a18d-9054cb772d43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3.630321d1-a024-449d-9b64-adab9e1f98d1" returned: 0 in 0.387s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:52 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-630321d1-a024-449d-9b64-adab9e1f98d1" released by "_delete_snapshot" :: held 2.189s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c" returned: 0 in 0.535s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-251863e3-54a3-400f-94d6-6447072b62c3" released by "delete_snapshot" :: held 2.269s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:52 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd 1G Jul 30 16:39:52 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Acquiring lock "cinder-quobyte-1329b3da-a847-44fb-a18d-9054cb772d43" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Lock "cinder-quobyte-1329b3da-a847-44fb-a18d-9054cb772d43" acquired by "delete_volume" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d9bc8-ef75-41b4-8734-164dd5edd3c6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Created reservations ['cc78ffcd-67fc-4f34-b7b4-5eb041f41faf', '47d4fbe6-82fe-43c7-ad2c-11b4f0a8feaf', '05af4ec9-d359-4861-a49d-d1a0f1cf7656', '7744dc7a-5621-4367-acd5-e5b29642c18b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:53 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 Jul 30 16:39:53 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Delete snapshot completed successfully. Jul 30 16:39:53 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5ebbb28d-33e0-448a-8f2a-f7c99a5eac4f tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-630321d1-a024-449d-9b64-adab9e1f98d1-delete_snapshot" released by "delete_snapshot" :: held 2.580s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:53 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd 1G" returned: 0 in 0.551s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d2e755-f560-4734-8df9-e36b5fadad6c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:53 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43" returned: 0 in 0.448s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:53 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d2e755-f560-4734-8df9-e36b5fadad6c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd Jul 30 16:39:53 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:53 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43 Jul 30 16:39:53 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:53 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1329b3da-a847-44fb-a18d-9054cb772d43" returned: 0 in 0.305s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:53 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d2e755-f560-4734-8df9-e36b5fadad6c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd" returned: 0 in 0.344s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:53 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd is being set with open permissions: ugo+rw Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Lock "cinder-quobyte-1329b3da-a847-44fb-a18d-9054cb772d43" released by "delete_volume" :: held 0.831s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:53 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd Jul 30 16:39:53 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-251863e3-54a3-400f-94d6-6447072b62c3-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-251863e3-54a3-400f-94d6-6447072b62c3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Created reservations ['15281b1a-1aa0-44b0-aec1-7ef79c01f089', '40a4d530-b193-48b8-8a0e-aca9a4872d09', 'd56e525a-e5b3-450c-b102-9c84f82351e9', '461b6dc3-c193-4006-b771-1aa876def4ac'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "cinder-quobyte-251863e3-54a3-400f-94d6-6447072b62c3" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-251863e3-54a3-400f-94d6-6447072b62c3" acquired by "delete_volume" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d46b03-cf1d-4ba0-bf36-16360b8c1e15]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:54 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd" returned: 0 in 0.333s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:54 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:54 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:54 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.info Jul 30 16:39:54 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:54 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 Jul 30 16:39:54 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:54 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.259s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Deleted volume successfully. Jul 30 16:39:54 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.info" returned: 0 in 0.274s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:54 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.info is being set with open permissions: ugo+rw Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-610185a1-e7d2-474c-9eba-cd45021fb35e tempest-TestMinimumBasicScenario-81492806 None] Lock "cinder-1329b3da-a847-44fb-a18d-9054cb772d43-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:54 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.info Jul 30 16:39:54 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:54 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3" returned: 0 in 0.439s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:54 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3 Jul 30 16:39:54 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:54 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.info" returned: 0 in 0.250s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8981debd-ae3b-4c1b-b95f-abef9b4816f5 tempest-SnapshotDependencyTests-327443766 None] Create snapshot completed successfully Jul 30 16:39:54 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-251863e3-54a3-400f-94d6-6447072b62c3" returned: 0 in 0.235s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-quobyte-251863e3-54a3-400f-94d6-6447072b62c3" released by "delete_volume" :: held 0.773s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Created reservations ['1f1824c2-22f6-4178-818b-c12d3fd23c40', '9d48ea54-cb43-49d5-bcb8-5b39a864dfeb', 'b2c62672-5097-4891-be4c-85ed3e057da5', '28c917a4-32a4-4e9a-a5c8-c4d2fd795ddb'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:54 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:39:54 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:55 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.246s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:55 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:55 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Deleted volume successfully. Jul 30 16:39:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9448ba20-fc60-4d2c-9320-3b51078b03c9 tempest-CreateVolumesFromSnapshotTest-899703954 None] Lock "cinder-251863e3-54a3-400f-94d6-6447072b62c3-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Flow 'volume_create_manager' (13cfe83d-e781-4d2d-8b6e-62ec9b12b066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798df66f-22ca-4b4e-b250-0e872a6e0949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798df66f-22ca-4b4e-b250-0e872a6e0949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f41078-1a0e-4738-90ec-08718058f68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='053b9c35eeab446e83de0c6c9222a9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9daa98fa-86f9-44d6-a590-788673ba88dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:57Z,use_quota=True,user_id='26d95ef7b206463ba0f94b8064782a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9100fca4-7da1-4bfc-8dc8-7d1d3e7013ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9100fca4-7da1-4bfc-8dc8-7d1d3e7013ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b272c746-9256-42ec-a98f-5577bf1443fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b272c746-9256-42ec-a98f-5577bf1443fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74f41078-1a0e-4738-90ec-08718058f68e', 'volume_name': 'volume-74f41078-1a0e-4738-90ec-08718058f68e', 'volume_size': 1, 'snapshot_id': '9daa98fa-86f9-44d6-a590-788673ba88dd'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19584e34-4981-419a-8a79-0ccc39b4f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19584e34-4981-419a-8a79-0ccc39b4f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7093760e-5483-46e2-931d-70b1f470d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:56 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Volume 74f41078-1a0e-4738-90ec-08718058f68e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74f41078-1a0e-4738-90ec-08718058f68e', 'volume_size': 1, 'snapshot_id': '9daa98fa-86f9-44d6-a590-788673ba88dd'} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-quobyte-9daa98fa-86f9-44d6-a590-788673ba88dd-74f41078-1a0e-4738-90ec-08718058f68e" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-9daa98fa-86f9-44d6-a590-788673ba88dd-74f41078-1a0e-4738-90ec-08718058f68e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Creating volume 74f41078-1a0e-4738-90ec-08718058f68e from snapshot 9daa98fa-86f9-44d6-a590-788673ba88dd {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-quobyte-74f41078-1a0e-4738-90ec-08718058f68e" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-74f41078-1a0e-4738-90ec-08718058f68e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] snapshot: 9daa98fa-86f9-44d6-a590-788673ba88dd, volume: 74f41078-1a0e-4738-90ec-08718058f68e, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e25254-012c-408c-a21c-ca1a2c90c180]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:57 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd Jul 30 16:39:57 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:57 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd" returned: 0 in 0.584s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d2e755-f560-4734-8df9-e36b5fadad6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:39:57 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ec5e8-c85c-4ba3-9b99-251002ae101f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:57 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c Jul 30 16:39:57 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:57 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-caa148a3-1a02-4b9b-9fd2-e42b57254932 req-599e2338-093f-40b0-bb04-a9a8df659fcd tempest-AttachVolumeNegativeTest-2093205215 None] Terminate volume connection completed successfully. Jul 30 16:39:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-caa148a3-1a02-4b9b-9fd2-e42b57254932 req-599e2338-093f-40b0-bb04-a9a8df659fcd tempest-AttachVolumeNegativeTest-2093205215 None] Deleting attachment 53cccebd-5bef-4221-ae38-8df0cd539a58. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:39:58 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c" returned: 0 in 0.530s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:39:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:39:58 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:39:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:58 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e Jul 30 16:39:58 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (0c60770d-82dc-4c44-a34e-59b07da61b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fb351d-4522-48b2-9ff5-8eec0bd744dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fb351d-4522-48b2-9ff5-8eec0bd744dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-676424476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e25c3ef-9afd-4123-bba3-4b377322bd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:01Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e379544-6941-4201-a7c1-38727d868e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e379544-6941-4201-a7c1-38727d868e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18402dcf-4dc2-43a3-93c3-837c88b21131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18402dcf-4dc2-43a3-93c3-837c88b21131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e25c3ef-9afd-4123-bba3-4b377322bd06', 'volume_name': 'volume-8e25c3ef-9afd-4123-bba3-4b377322bd06', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fa5cc7-668b-40ef-9163-0863a6f3307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fa5cc7-668b-40ef-9163-0863a6f3307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8da8121-ab13-47c2-9872-68b3997b8455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:01 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume 8e25c3ef-9afd-4123-bba3-4b377322bd06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e25c3ef-9afd-4123-bba3-4b377322bd06', 'volume_size': 1} Jul 30 16:40:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:04 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e" returned: 0 in 6.233s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:40:04 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Converted 1024.00 MB image at 164.25 MB/s Jul 30 16:40:04 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e is being set with open permissions: ugo+rw Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:04 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e Jul 30 16:40:04 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:04 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e" returned: 0 in 0.349s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-74f41078-1a0e-4738-90ec-08718058f68e" released by "_copy_volume_from_snapshot" :: held 7.821s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-9daa98fa-86f9-44d6-a590-788673ba88dd-74f41078-1a0e-4738-90ec-08718058f68e" released by "_create_volume_from_snapshot" :: held 7.898s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.917s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.830s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-676424476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e25c3ef-9afd-4123-bba3-4b377322bd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:01Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Creating volume 8e25c3ef-9afd-4123-bba3-4b377322bd06 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:04 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:04 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 1073741824 Jul 30 16:40:04 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7093760e-5483-46e2-931d-70b1f470d400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f41078-1a0e-4738-90ec-08718058f68e', 'volume_size': 1, 'snapshot_id': '9daa98fa-86f9-44d6-a590-788673ba88dd'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839f2563-beff-4631-b2c3-19c2b18438ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:04 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Volume volume-74f41078-1a0e-4738-90ec-08718058f68e (74f41078-1a0e-4738-90ec-08718058f68e): created successfully Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839f2563-beff-4631-b2c3-19c2b18438ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Flow 'volume_create_manager' (13cfe83d-e781-4d2d-8b6e-62ec9b12b066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a7f75e05-b5ba-40c4-843f-fd21d2a9e30d tempest-SnapshotDependencyTests-327443766 None] Created volume successfully. Jul 30 16:40:05 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 1073741824" returned: 0 in 0.548s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:05 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 Jul 30 16:40:05 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:05 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06" returned: 0 in 0.312s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-9daa98fa-86f9-44d6-a590-788673ba88dd-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8da8121-ab13-47c2-9872-68b3997b8455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e25c3ef-9afd-4123-bba3-4b377322bd06', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db833ed6-ab9b-4eca-b78b-8a8faf6ab972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:05 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 (8e25c3ef-9afd-4123-bba3-4b377322bd06): created successfully Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db833ed6-ab9b-4eca-b78b-8a8faf6ab972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (0c60770d-82dc-4c44-a34e-59b07da61b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-9daa98fa-86f9-44d6-a590-788673ba88dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-quobyte-e6d2e755-f560-4734-8df9-e36b5fadad6c" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-e6d2e755-f560-4734-8df9-e36b5fadad6c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-quobyte-9daa98fa-86f9-44d6-a590-788673ba88dd" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-37ec7a20-9062-443c-a8cb-b2579c2c7deb tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created volume successfully. Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-9daa98fa-86f9-44d6-a590-788673ba88dd" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Deleting offline snapshot 9daa98fa-86f9-44d6-a590-788673ba88dd of volume e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] snapshot_file for this snap is: volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b22acb3-36bd-4fd8-9794-0730d6a95973]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:05 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd Jul 30 16:40:05 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:06 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd" returned: 0 in 0.486s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d2e755-f560-4734-8df9-e36b5fadad6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:40:06 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3ac896-4c92-47ba-a467-8a10577a2eb7]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:06 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c Jul 30 16:40:06 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:07 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c" returned: 0 in 0.752s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:07 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd Jul 30 16:40:07 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:07 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (86825abb-9a8f-4481-9f5d-6369cac95e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922f07c-8a4c-492e-af98-bb18fab8c97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd" returned: 0 in 0.629s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922f07c-8a4c-492e-af98-bb18fab8c97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1560046493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e490e15a-b994-49a8-8640-d173a6a381ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:08Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3a3fd1-306a-414d-8a08-8126deb6a069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3a3fd1-306a-414d-8a08-8126deb6a069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472f51b2-ba14-4e3d-ac01-bd02f2fd51a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472f51b2-ba14-4e3d-ac01-bd02f2fd51a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e490e15a-b994-49a8-8640-d173a6a381ff', 'volume_name': 'volume-e490e15a-b994-49a8-8640-d173a6a381ff', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:07 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20542e84-5130-4a3d-bfaa-91bdb8d8036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:07 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20542e84-5130-4a3d-bfaa-91bdb8d8036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccb79ff-1742-4353-9cfe-35ea998143b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:07 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume e490e15a-b994-49a8-8640-d173a6a381ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e490e15a-b994-49a8-8640-d173a6a381ff', 'volume_size': 1} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1560046493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e490e15a-b994-49a8-8640-d173a6a381ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:08Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Creating volume e490e15a-b994-49a8-8640-d173a6a381ff {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:07 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:07 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff 1073741824 Jul 30 16:40:07 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (6eab121e-e193-4fd7-b644-6d8c35a1c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df094a26-5500-4742-a051-8cfd9b74c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df094a26-5500-4742-a051-8cfd9b74c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-326764037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aa3142-78e3-435b-a702-68aecaaba328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:08Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:08 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6da3771-42fb-4e2a-a7c4-81e8b277ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6da3771-42fb-4e2a-a7c4-81e8b277ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b09de33-10e3-4534-bbad-c762e42df6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b09de33-10e3-4534-bbad-c762e42df6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17aa3142-78e3-435b-a702-68aecaaba328', 'volume_name': 'volume-17aa3142-78e3-435b-a702-68aecaaba328', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d12947-7bdd-4427-94a2-1577d3c4b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d12947-7bdd-4427-94a2-1577d3c4b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c06caa-60db-404e-acc2-6e683124e0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:08 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume 17aa3142-78e3-435b-a702-68aecaaba328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17aa3142-78e3-435b-a702-68aecaaba328', 'volume_size': 1} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c.9daa98fa-86f9-44d6-a590-788673ba88dd" returned: 0 in 0.644s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-9daa98fa-86f9-44d6-a590-788673ba88dd" released by "_delete_snapshot" :: held 2.670s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-e6d2e755-f560-4734-8df9-e36b5fadad6c" released by "delete_snapshot" :: held 2.718s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Created reservations ['a625a323-02e2-4c98-beb5-984ae2f2652f', '6b9ba7e2-c5b1-4666-a3f7-5302e96a5c77', 'ff317896-4f7a-4846-b083-a37d7894156a', 'b5deb14d-c2b4-471b-aa23-8cfc96b02a68'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:08 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff 1073741824" returned: 0 in 0.855s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Delete snapshot completed successfully. Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0e714fab-cecb-4132-823b-5b269dd99fa2 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-9daa98fa-86f9-44d6-a590-788673ba88dd-delete_snapshot" released by "delete_snapshot" :: held 3.007s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:08 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff Jul 30 16:40:08 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (8ae76ad2-bc35-49e3-9ad0-8faee298a724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:08 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4356947a-0b9f-4827-8d18-f2d520b49f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4356947a-0b9f-4827-8d18-f2d520b49f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843222302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3192c8-af38-4443-beec-be158bf35165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:09Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99af29c0-bdff-442d-ab68-62c5eedd70f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99af29c0-bdff-442d-ab68-62c5eedd70f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beec2c98-f2e2-45e7-ac50-7d2381189903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beec2c98-f2e2-45e7-ac50-7d2381189903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3192c8-af38-4443-beec-be158bf35165', 'volume_name': 'volume-eb3192c8-af38-4443-beec-be158bf35165', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e651107d-ffd2-476b-8416-e422c5709786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e651107d-ffd2-476b-8416-e422c5709786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3c5cef-c709-4443-abcf-5525f7c12249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume eb3192c8-af38-4443-beec-be158bf35165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3192c8-af38-4443-beec-be158bf35165', 'volume_size': 1} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-e6d2e755-f560-4734-8df9-e36b5fadad6c-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:09 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff" returned: 0 in 0.388s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-326764037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aa3142-78e3-435b-a702-68aecaaba328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:08Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Creating volume 17aa3142-78e3-435b-a702-68aecaaba328 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:09 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:09 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 1073741824 Jul 30 16:40:09 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-e6d2e755-f560-4734-8df9-e36b5fadad6c-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccb79ff-1742-4353-9cfe-35ea998143b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e490e15a-b994-49a8-8640-d173a6a381ff', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21ae742-ca24-41fa-8e0e-910a339cdac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume volume-e490e15a-b994-49a8-8640-d173a6a381ff (e490e15a-b994-49a8-8640-d173a6a381ff): created successfully Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21ae742-ca24-41fa-8e0e-910a339cdac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (86825abb-9a8f-4481-9f5d-6369cac95e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7d3b2e42-39f2-4761-b45c-d2c51b153079 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created volume successfully. Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-quobyte-e6d2e755-f560-4734-8df9-e36b5fadad6c" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-e6d2e755-f560-4734-8df9-e36b5fadad6c" acquired by "delete_volume" :: waited 0.051s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e062d2c-a235-4ce5-87a3-6c1a7f047f7f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (dbf9dd59-3b10-438e-93ce-30366b11076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dffa8ae-be04-48e4-8f0f-bd2d5ef162ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c Jul 30 16:40:09 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dffa8ae-be04-48e4-8f0f-bd2d5ef162ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-113780075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4433a14-1d93-49e1-a41d-3b43895eb542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:10Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b87fbd-f97f-417a-a4d5-7966c8108185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b87fbd-f97f-417a-a4d5-7966c8108185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8f8671-b8d1-4cf1-881f-b004627734ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8f8671-b8d1-4cf1-881f-b004627734ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4433a14-1d93-49e1-a41d-3b43895eb542', 'volume_name': 'volume-d4433a14-1d93-49e1-a41d-3b43895eb542', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d1fc35-b3ee-4566-b4c4-2153cfdbf1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d1fc35-b3ee-4566-b4c4-2153cfdbf1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8c15cd-f0a3-41b0-9866-84e272660efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume d4433a14-1d93-49e1-a41d-3b43895eb542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4433a14-1d93-49e1-a41d-3b43895eb542', 'volume_size': 1} Jul 30 16:40:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:10 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 1073741824" returned: 0 in 0.839s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:10 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 Jul 30 16:40:10 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (2ba1ab71-efb2-4cdc-bc85-59a9260b3c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d5f107-0775-465e-b863-dedf0ef5df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:10 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c" returned: 0 in 0.745s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d5f107-0775-465e-b863-dedf0ef5df4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1599907502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f6595c-2a8b-4907-98b9-5b1442f51697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:10Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b841acb2-62c1-4882-8986-fe0ee905d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b841acb2-62c1-4882-8986-fe0ee905d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:10 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c Jul 30 16:40:10 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3566a4-98d5-4c5e-ad44-088635a89f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3566a4-98d5-4c5e-ad44-088635a89f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f6595c-2a8b-4907-98b9-5b1442f51697', 'volume_name': 'volume-d6f6595c-2a8b-4907-98b9-5b1442f51697', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4581c306-cc31-495b-aacd-461a6e32a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4581c306-cc31-495b-aacd-461a6e32a240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35264769-e74a-4d85-9097-868ca7fb7554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:10 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume d6f6595c-2a8b-4907-98b9-5b1442f51697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f6595c-2a8b-4907-98b9-5b1442f51697', 'volume_size': 1} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:10 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328" returned: 0 in 0.453s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843222302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3192c8-af38-4443-beec-be158bf35165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:09Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Creating volume eb3192c8-af38-4443-beec-be158bf35165 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:10 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c06caa-60db-404e-acc2-6e683124e0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17aa3142-78e3-435b-a702-68aecaaba328', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:10 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 1073741824 Jul 30 16:40:10 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb4c827-69cc-40b5-8dea-419026a4f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:10 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume volume-17aa3142-78e3-435b-a702-68aecaaba328 (17aa3142-78e3-435b-a702-68aecaaba328): created successfully Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb4c827-69cc-40b5-8dea-419026a4f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (6eab121e-e193-4fd7-b644-6d8c35a1c215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-845b2d54-d8fc-4e2c-a3ba-1050ee4e7b9b tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created volume successfully. Jul 30 16:40:10 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6d2e755-f560-4734-8df9-e36b5fadad6c" returned: 0 in 0.434s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-e6d2e755-f560-4734-8df9-e36b5fadad6c" released by "delete_volume" :: held 1.311s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Created reservations ['e7c62fd5-8572-4c68-b45b-1313d3e664a5', 'b458d8d6-e89c-4ddf-bdc7-06c2885ae7a0', '57a2d11c-eb36-426b-982f-f4214e7a6035', '57195634-de1c-4eea-b49b-bbf9e2ccbb85'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:11 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:11 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:11 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 1073741824" returned: 0 in 0.650s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:11 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:11 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.362s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:11 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Deleted volume successfully. Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fba7a05c-5148-4dcd-9c47-21d73f50f46a tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-e6d2e755-f560-4734-8df9-e36b5fadad6c-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-74f41078-1a0e-4738-90ec-08718058f68e-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-74f41078-1a0e-4738-90ec-08718058f68e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "cinder-quobyte-74f41078-1a0e-4738-90ec-08718058f68e" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-74f41078-1a0e-4738-90ec-08718058f68e" acquired by "delete_volume" :: waited 0.041s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[161fdbce-9571-4058-bd3a-901fd778fa40]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:11 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165" returned: 0 in 0.506s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.941s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-113780075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4433a14-1d93-49e1-a41d-3b43895eb542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:10Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Creating volume d4433a14-1d93-49e1-a41d-3b43895eb542 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:11 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:11 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 1073741824 Jul 30 16:40:11 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3c5cef-c709-4443-abcf-5525f7c12249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3192c8-af38-4443-beec-be158bf35165', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:11 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486e36aa-14e4-4000-b59d-1ab2cdcbe454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:11 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:11 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume volume-eb3192c8-af38-4443-beec-be158bf35165 (eb3192c8-af38-4443-beec-be158bf35165): created successfully Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486e36aa-14e4-4000-b59d-1ab2cdcbe454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (8ae76ad2-bc35-49e3-9ad0-8faee298a724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-412f5155-82c7-4445-8701-3d9af7b409b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created volume successfully. Jul 30 16:40:12 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e" returned: 0 in 0.608s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:12 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e Jul 30 16:40:12 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:12 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 1073741824" returned: 0 in 0.745s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:12 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 Jul 30 16:40:12 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:12 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-74f41078-1a0e-4738-90ec-08718058f68e" returned: 0 in 0.470s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-quobyte-74f41078-1a0e-4738-90ec-08718058f68e" released by "delete_volume" :: held 1.182s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:12 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Created reservations ['7ff1c2b3-a109-4924-b60e-a244b13ad3ed', 'fd7ede38-64f1-4ba2-a147-802072452ecd', '90e4ccb7-c246-489a-a656-9ab367c112eb', '26468c58-be34-40dc-b084-cb13e4f40878'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:13 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:13 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:13 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542" returned: 0 in 0.425s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.653s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1599907502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f6595c-2a8b-4907-98b9-5b1442f51697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf326a762b54f3c87bed01d3b50e38e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:10Z,use_quota=True,user_id='2378f067fa184593a93844aeac634b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Creating volume d6f6595c-2a8b-4907-98b9-5b1442f51697 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:13 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8c15cd-f0a3-41b0-9866-84e272660efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4433a14-1d93-49e1-a41d-3b43895eb542', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:13 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 1073741824 Jul 30 16:40:13 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940661c6-5063-4e66-91c3-0ea34d49e1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:13 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume volume-d4433a14-1d93-49e1-a41d-3b43895eb542 (d4433a14-1d93-49e1-a41d-3b43895eb542): created successfully Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940661c6-5063-4e66-91c3-0ea34d49e1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (dbf9dd59-3b10-438e-93ce-30366b11076b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a7ce3301-f7f6-482d-a010-d36fd20e2851 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created volume successfully. Jul 30 16:40:13 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.419s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Deleted volume successfully. Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-24c5733a-edae-48af-b0a1-61f178e693a7 tempest-SnapshotDependencyTests-327443766 None] Lock "cinder-74f41078-1a0e-4738-90ec-08718058f68e-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:13 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 1073741824" returned: 0 in 0.742s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:13 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 Jul 30 16:40:13 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:14 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697" returned: 0 in 0.352s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35264769-e74a-4d85-9097-868ca7fb7554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f6595c-2a8b-4907-98b9-5b1442f51697', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117df202-99ca-4af8-a7e5-2236a6e5685a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:14 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Volume volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 (d6f6595c-2a8b-4907-98b9-5b1442f51697): created successfully Jul 30 16:40:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117df202-99ca-4af8-a7e5-2236a6e5685a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Flow 'volume_create_manager' (2ba1ab71-efb2-4cdc-bc85-59a9260b3c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-388888a6-abe4-4b01-8270-cfa204ff8a8a tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created volume successfully. Jul 30 16:40:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-d6f6595c-2a8b-4907-98b9-5b1442f51697-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-d6f6595c-2a8b-4907-98b9-5b1442f51697-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-quobyte-d6f6595c-2a8b-4907-98b9-5b1442f51697" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-d6f6595c-2a8b-4907-98b9-5b1442f51697" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:15 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4644b21-ce11-473b-bb58-844752130671]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:15 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 Jul 30 16:40:15 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:15 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697" returned: 0 in 0.539s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:15 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697 Jul 30 16:40:15 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:16 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6f6595c-2a8b-4907-98b9-5b1442f51697" returned: 0 in 0.349s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-d6f6595c-2a8b-4907-98b9-5b1442f51697" released by "delete_volume" :: held 0.939s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created reservations ['ad2b8a3d-3fd6-48d6-98d7-8767c7ad90e4', '17d2150f-7941-4252-9157-95775f9117eb', '585b6511-0c38-462f-a536-db0dd03b0b83', '065040ee-b37b-41f2-8d4a-336dd2a8b53f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:16 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:16 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:16 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.355s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:16 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Deleted volume successfully. Jul 30 16:40:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9232ef33-a398-4dfd-8158-0cf22433829d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-d6f6595c-2a8b-4907-98b9-5b1442f51697-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-d4433a14-1d93-49e1-a41d-3b43895eb542-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-d4433a14-1d93-49e1-a41d-3b43895eb542-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-quobyte-d4433a14-1d93-49e1-a41d-3b43895eb542" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-d4433a14-1d93-49e1-a41d-3b43895eb542" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:17 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe587db-faf9-48c0-8a24-836661459b2d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:18 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 Jul 30 16:40:18 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:18 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542" returned: 0 in 0.749s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:18 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542 Jul 30 16:40:18 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:19 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d4433a14-1d93-49e1-a41d-3b43895eb542" returned: 0 in 0.474s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-d4433a14-1d93-49e1-a41d-3b43895eb542" released by "delete_volume" :: held 1.339s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created reservations ['31d74446-fe31-4727-a6d5-0086671530a9', 'acb3d2ca-c808-4246-88d9-a692004643e7', 'f35d708a-6961-469e-8c41-51c39c07773b', 'c9a6a014-f16c-45fc-b6d8-f8f7c964a212'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:19 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:19 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:19 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.404s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:19 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Deleted volume successfully. Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e442f3b9-e0db-420c-be77-90c6c512a262 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-d4433a14-1d93-49e1-a41d-3b43895eb542-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-eb3192c8-af38-4443-beec-be158bf35165-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-eb3192c8-af38-4443-beec-be158bf35165-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-quobyte-eb3192c8-af38-4443-beec-be158bf35165" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-eb3192c8-af38-4443-beec-be158bf35165" acquired by "delete_volume" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:20 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1d49e1-b99a-4eae-8cf1-b6d08dd04741]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:20 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 Jul 30 16:40:20 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:20 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165" returned: 0 in 0.744s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:21 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165 Jul 30 16:40:21 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:21 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb3192c8-af38-4443-beec-be158bf35165" returned: 0 in 0.478s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-eb3192c8-af38-4443-beec-be158bf35165" released by "delete_volume" :: held 1.350s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created reservations ['3a8219fa-e5fd-4135-804d-16e34ef6b9ff', '2e710e01-44bf-4bb4-bd98-9cd79e6d2818', 'a06f7dfd-c9e5-454d-9628-92ee7d4e8543', '6500fb3f-2789-4b78-9db6-21cd5fe65beb'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:21 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:21 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:22 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.423s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:22 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Deleted volume successfully. Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32d968e6-6e2b-4d69-a786-9b9e8d82ebdd tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-eb3192c8-af38-4443-beec-be158bf35165-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-17aa3142-78e3-435b-a702-68aecaaba328-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-17aa3142-78e3-435b-a702-68aecaaba328-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-quobyte-17aa3142-78e3-435b-a702-68aecaaba328" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-17aa3142-78e3-435b-a702-68aecaaba328" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc2b20c-d849-4c33-8d92-abdcb4ad29bc]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:22 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 Jul 30 16:40:22 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:23 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328" returned: 0 in 0.523s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:23 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328 Jul 30 16:40:23 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:23 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-17aa3142-78e3-435b-a702-68aecaaba328" returned: 0 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-17aa3142-78e3-435b-a702-68aecaaba328" released by "delete_volume" :: held 0.949s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created reservations ['68c30d80-8de1-41b6-becd-a699e581e568', 'e05887a3-5907-4283-bf8f-5926cdbc8e5d', '1928827a-0d6f-47f1-b432-369a9b5ac140', '5e4551a0-5128-428c-adb6-18d59f93c623'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:23 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:23 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:24 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.324s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:24 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Deleted volume successfully. Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3650e6a4-e6c9-4592-a317-7ec546b4873d tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-17aa3142-78e3-435b-a702-68aecaaba328-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-e490e15a-b994-49a8-8640-d173a6a381ff-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-e490e15a-b994-49a8-8640-d173a6a381ff-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-quobyte-e490e15a-b994-49a8-8640-d173a6a381ff" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-e490e15a-b994-49a8-8640-d173a6a381ff" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f000c0d4-7ab5-4a20-b999-6144f77e3e7e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:25 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff Jul 30 16:40:25 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:25 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff" returned: 0 in 0.647s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:25 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff Jul 30 16:40:25 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:25 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e490e15a-b994-49a8-8640-d173a6a381ff" returned: 0 in 0.354s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-e490e15a-b994-49a8-8640-d173a6a381ff" released by "delete_volume" :: held 1.080s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created reservations ['bb4c0611-9fbf-46d8-afc3-2f8cc06121ec', '22f82d1a-3bd8-4235-b512-0dad4a6d4bdb', '6380f11e-fb91-4041-bf4a-a64bb99ddc27', '29609598-b338-43ad-af12-265f121afd72'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:26 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:26 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:26 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.310s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:26 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Deleted volume successfully. Jul 30 16:40:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-058e8d4b-f1dd-4741-bcda-221f1f60da61 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-e490e15a-b994-49a8-8640-d173a6a381ff-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-8e25c3ef-9afd-4123-bba3-4b377322bd06-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-8e25c3ef-9afd-4123-bba3-4b377322bd06-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "cinder-quobyte-8e25c3ef-9afd-4123-bba3-4b377322bd06" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-8e25c3ef-9afd-4123-bba3-4b377322bd06" acquired by "delete_volume" :: waited 0.053s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:27 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af226f00-9fb2-4817-84a3-77bfe123a66a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:27 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 Jul 30 16:40:27 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:28 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06" returned: 0 in 0.837s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:28 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06 Jul 30 16:40:28 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:28 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8e25c3ef-9afd-4123-bba3-4b377322bd06" returned: 0 in 0.471s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-quobyte-8e25c3ef-9afd-4123-bba3-4b377322bd06" released by "delete_volume" :: held 1.437s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=180,cinder:SELECT=113,cinder:INSERT=44,cinder:DELETE=17 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=130,cinder:UPDATE=157,cinder:INSERT=36,cinder:DELETE=13 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Created reservations ['f9c25fea-3088-45a9-864f-15edf220b78b', '5e6bc0b2-3ac2-4598-9346-e6166058fe1c', '5c947319-f5e2-4dd6-9753-434585a3d955', '4683c542-90c3-46e4-aa03-df30f732cd04'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:28 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:28 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:29 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.435s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:29 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:29 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Deleted volume successfully. Jul 30 16:40:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-45c58011-b3ab-4195-b6e8-51ee21f701b3 tempest-CreateVolumesFromSourceVolumeTest-1742291423 None] Lock "cinder-8e25c3ef-9afd-4123-bba3-4b377322bd06-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:38 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=6 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:40:39 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=9,cinder:SELECT=1,cinder:DELETE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Flow 'volume_create_manager' (7d89e943-0053-4df4-bb9a-75f221fb5800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f720aef2-fc96-4b36-9fbc-8662f5e94fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f720aef2-fc96-4b36-9fbc-8662f5e94fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633461072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de4b183-c4c0-4d73-aafb-21cdef5e3a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f4df7040e24720acf57c1f46130b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:41Z,use_quota=True,user_id='4070bc594a1e4c7298abbf242b81e403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4bf93b-173e-4bec-9bac-da5fed9847f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4bf93b-173e-4bec-9bac-da5fed9847f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9e9e4e-e579-4e7c-8dde-ba5dbf6943b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9e9e4e-e579-4e7c-8dde-ba5dbf6943b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de4b183-c4c0-4d73-aafb-21cdef5e3a93', 'volume_name': 'volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c0477f-c325-47c2-9edb-cb3601576b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c0477f-c325-47c2-9edb-cb3601576b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bd6d91-a8f3-4d59-a71f-d98796da4df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Volume 2de4b183-c4c0-4d73-aafb-21cdef5e3a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93', 'volume_size': 1} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633461072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de4b183-c4c0-4d73-aafb-21cdef5e3a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f4df7040e24720acf57c1f46130b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:41Z,use_quota=True,user_id='4070bc594a1e4c7298abbf242b81e403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Creating volume 2de4b183-c4c0-4d73-aafb-21cdef5e3a93 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:41 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:41 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 1073741824 Jul 30 16:40:41 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:42 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 1073741824" returned: 0 in 0.602s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:42 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 Jul 30 16:40:42 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:42 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93" returned: 0 in 0.270s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bd6d91-a8f3-4d59-a71f-d98796da4df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5f9bf7-ef1b-461e-b9c4-f1cfdbdeddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:42 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Volume volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 (2de4b183-c4c0-4d73-aafb-21cdef5e3a93): created successfully Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5f9bf7-ef1b-461e-b9c4-f1cfdbdeddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Flow 'volume_create_manager' (7d89e943-0053-4df4-bb9a-75f221fb5800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Flow 'volume_create_manager' (594c4073-593e-41f2-b9a5-d24069585cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986fd056-9065-405e-8666-8bb26e5fa2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986fd056-9065-405e-8666-8bb26e5fa2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1562890329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea89e8b-ce28-4392-99e3-1a2947185a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f67128549f4dd08cb177f8025fa595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:42Z,use_quota=True,user_id='6fc6f2de2f0149d391bfa10af1102389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5931bfc0-c913-4898-8500-0cf05b6b430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5931bfc0-c913-4898-8500-0cf05b6b430f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145ba5c1-e45c-42aa-9b7f-797eba12cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145ba5c1-e45c-42aa-9b7f-797eba12cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea89e8b-ce28-4392-99e3-1a2947185a3d', 'volume_name': 'volume-dea89e8b-ce28-4392-99e3-1a2947185a3d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4c101b-a999-4df4-8596-27ff461d7831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4c101b-a999-4df4-8596-27ff461d7831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781e1c49-673c-4e22-be29-296099cc2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:42 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Volume dea89e8b-ce28-4392-99e3-1a2947185a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea89e8b-ce28-4392-99e3-1a2947185a3d', 'volume_size': 1} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1562890329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea89e8b-ce28-4392-99e3-1a2947185a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f67128549f4dd08cb177f8025fa595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:42Z,use_quota=True,user_id='6fc6f2de2f0149d391bfa10af1102389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Creating volume dea89e8b-ce28-4392-99e3-1a2947185a3d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:42 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:42 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ca0730a4-1765-4307-8a32-cf57a62164b6 tempest-ProjectReaderTests-79530553 None] Created volume successfully. Jul 30 16:40:42 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d 1073741824 Jul 30 16:40:42 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:43 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d 1073741824" returned: 0 in 0.464s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:43 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d Jul 30 16:40:43 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:43 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d" returned: 0 in 0.254s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781e1c49-673c-4e22-be29-296099cc2314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea89e8b-ce28-4392-99e3-1a2947185a3d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead3bc1-585a-4bee-a9b6-befb2ac88834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:43 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Volume volume-dea89e8b-ce28-4392-99e3-1a2947185a3d (dea89e8b-ce28-4392-99e3-1a2947185a3d): created successfully Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead3bc1-585a-4bee-a9b6-befb2ac88834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Flow 'volume_create_manager' (594c4073-593e-41f2-b9a5-d24069585cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a6c6c19d-c164-4c95-8462-b45986438efa tempest-AttachVolumeNegativeTest-2093205215 None] Created volume successfully. Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Acquiring lock "cinder-2de4b183-c4c0-4d73-aafb-21cdef5e3a93-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Lock "cinder-2de4b183-c4c0-4d73-aafb-21cdef5e3a93-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Acquiring lock "cinder-quobyte-2de4b183-c4c0-4d73-aafb-21cdef5e3a93" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Lock "cinder-quobyte-2de4b183-c4c0-4d73-aafb-21cdef5e3a93" acquired by "delete_volume" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab56ad1-5023-41f2-99fa-c08721f5fdd8]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:44 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 Jul 30 16:40:44 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:44 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93" returned: 0 in 0.514s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:44 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93 Jul 30 16:40:44 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:44 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2de4b183-c4c0-4d73-aafb-21cdef5e3a93" returned: 0 in 0.341s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Lock "cinder-quobyte-2de4b183-c4c0-4d73-aafb-21cdef5e3a93" released by "delete_volume" :: held 0.919s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Created reservations ['77ddd5dd-7f28-4f57-8217-960422327287', '6ba555e1-eb09-40ea-99be-7714c976197e', '9eb2410f-37cb-4dee-80ba-300f7f576d02', 'f796f945-b74d-44fd-b130-efe6f13f876a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:44 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:44 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:45 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.375s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Deleted volume successfully. Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5cd25c07-2d6a-45dc-892f-2473e9efe39d tempest-ProjectReaderTests-79530553 None] Lock "cinder-2de4b183-c4c0-4d73-aafb-21cdef5e3a93-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2f961887-cf22-4f81-ba62-eb91cdc9c4ba req-927597f6-de79-4365-8f86-0bf2087d1f24 tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2f961887-cf22-4f81-ba62-eb91cdc9c4ba req-927597f6-de79-4365-8f86-0bf2087d1f24 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2f961887-cf22-4f81-ba62-eb91cdc9c4ba req-927597f6-de79-4365-8f86-0bf2087d1f24 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Flow 'volume_create_manager' (02d6aad4-9d8c-403d-8aea-1c4fc9656313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43a322e-4e0e-4bd8-a864-8a9779098a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-2f961887-cf22-4f81-ba62-eb91cdc9c4ba req-927597f6-de79-4365-8f86-0bf2087d1f24 tempest-AttachVolumeNegativeTest-2093205215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-dea89e8b-ce28-4392-99e3-1a2947185a3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3433d714-62ed-4411-9f4c-ad74d0efa074', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43a322e-4e0e-4bd8-a864-8a9779098a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574817480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940f3d61-4c24-40d3-ba5f-14c3d70631f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f4df7040e24720acf57c1f46130b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:46Z,use_quota=True,user_id='4070bc594a1e4c7298abbf242b81e403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ae57ff-5fee-4512-bca1-f6826a25a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ae57ff-5fee-4512-bca1-f6826a25a144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f5a461-592e-4547-8063-3c9870b3fb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f5a461-592e-4547-8063-3c9870b3fb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940f3d61-4c24-40d3-ba5f-14c3d70631f8', 'volume_name': 'volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb23012-172f-468f-928c-56a932bca5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb23012-172f-468f-928c-56a932bca5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6abcccc-9b30-48e7-9d19-b50828e83bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:45 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Volume 940f3d61-4c24-40d3-ba5f-14c3d70631f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8', 'volume_size': 1} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574817480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940f3d61-4c24-40d3-ba5f-14c3d70631f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f4df7040e24720acf57c1f46130b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:46Z,use_quota=True,user_id='4070bc594a1e4c7298abbf242b81e403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Creating volume 940f3d61-4c24-40d3-ba5f-14c3d70631f8 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:45 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:45 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 1073741824 Jul 30 16:40:45 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-2f961887-cf22-4f81-ba62-eb91cdc9c4ba req-927597f6-de79-4365-8f86-0bf2087d1f24 tempest-AttachVolumeNegativeTest-2093205215 None] attachment_update completed successfully. Jul 30 16:40:46 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 1073741824" returned: 0 in 0.529s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:46 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 Jul 30 16:40:46 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:46 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8" returned: 0 in 0.351s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6abcccc-9b30-48e7-9d19-b50828e83bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0402ec67-974c-4a9a-9098-56403b91e5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:46 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Volume volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 (940f3d61-4c24-40d3-ba5f-14c3d70631f8): created successfully Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0402ec67-974c-4a9a-9098-56403b91e5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Flow 'volume_create_manager' (02d6aad4-9d8c-403d-8aea-1c4fc9656313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-578c0cd0-abf5-4303-9fc7-bf944d376e9e tempest-ProjectReaderTests-79530553 None] Created volume successfully. Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:47 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:47 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:47 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.286s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Acquiring lock "cinder-940f3d61-4c24-40d3-ba5f-14c3d70631f8-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Lock "cinder-940f3d61-4c24-40d3-ba5f-14c3d70631f8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Acquiring lock "cinder-quobyte-940f3d61-4c24-40d3-ba5f-14c3d70631f8" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Lock "cinder-quobyte-940f3d61-4c24-40d3-ba5f-14c3d70631f8" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d25be-5fc3-4e9d-bd5b-8e41b1cb5212]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:48 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 Jul 30 16:40:48 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:48 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8" returned: 0 in 0.422s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:48 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8 Jul 30 16:40:48 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-6e2402b2-3d29-45d5-9e0b-4bfc91c0d9b2 req-35df17dc-0cde-4eee-8cf3-93e91d66172f tempest-AttachVolumeNegativeTest-2093205215 None] Terminate volume connection completed successfully. Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-6e2402b2-3d29-45d5-9e0b-4bfc91c0d9b2 req-35df17dc-0cde-4eee-8cf3-93e91d66172f tempest-AttachVolumeNegativeTest-2093205215 None] Deleting attachment 3433d714-62ed-4411-9f4c-ad74d0efa074. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:40:48 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-940f3d61-4c24-40d3-ba5f-14c3d70631f8" returned: 0 in 0.298s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Lock "cinder-quobyte-940f3d61-4c24-40d3-ba5f-14c3d70631f8" released by "delete_volume" :: held 0.782s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Created reservations ['35eea906-b277-426b-ba05-6eb7cceb9d9c', 'a61625c3-885c-43a8-aaab-8f7c0ef8de8a', '8cfa04bb-a919-441c-8811-2a9177d4b663', 'a9b92dd2-ec86-485d-8fa0-02b8d629efeb'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:48 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:48 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:49 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.286s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Deleted volume successfully. Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4b97777d-8b22-4224-85b5-23edb555cafb tempest-ProjectReaderTests-79530553 None] Lock "cinder-940f3d61-4c24-40d3-ba5f-14c3d70631f8-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Flow 'volume_create_manager' (ed4b9810-4e61-4885-b996-c1503f88f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f73992-3c7d-44c1-8498-711348fd1d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f73992-3c7d-44c1-8498-711348fd1d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1993374967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4ae8e3-a21b-46a1-8774-3672f7c78764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446c3121eace4fa2a6b5d6c44a28d256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:49Z,use_quota=True,user_id='e976947aadab46e9bb191ae2d9869d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d2ff9e-398e-464b-b586-16d3d00fd933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d2ff9e-398e-464b-b586-16d3d00fd933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78679843-79ab-4799-a1eb-47b7f0a2c214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Flow 'volume_create_manager' (963de85a-4545-4b93-a40d-afb617511a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f20b0cc-cfe6-49e7-9d07-20cc811cacc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f20b0cc-cfe6-49e7-9d07-20cc811cacc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614241585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cd3835-40ce-49d0-9fc5-2218f3acf4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f4df7040e24720acf57c1f46130b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:49Z,use_quota=True,user_id='4070bc594a1e4c7298abbf242b81e403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a61548b-9944-4247-a087-58c015bf6e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a61548b-9944-4247-a087-58c015bf6e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495dd820-6517-4c38-b26f-f0b65e51429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495dd820-6517-4c38-b26f-f0b65e51429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89cd3835-40ce-49d0-9fc5-2218f3acf4fd', 'volume_name': 'volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291aa4f2-383f-42b4-b5c8-2ba5252191d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291aa4f2-383f-42b4-b5c8-2ba5252191d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583fe621-1817-4b2b-a336-3cb002b8a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Volume 89cd3835-40ce-49d0-9fc5-2218f3acf4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd', 'volume_size': 1} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614241585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cd3835-40ce-49d0-9fc5-2218f3acf4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f4df7040e24720acf57c1f46130b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:49Z,use_quota=True,user_id='4070bc594a1e4c7298abbf242b81e403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Creating volume 89cd3835-40ce-49d0-9fc5-2218f3acf4fd {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:49 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:49 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd 1073741824 Jul 30 16:40:49 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78679843-79ab-4799-a1eb-47b7f0a2c214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb4ae8e3-a21b-46a1-8774-3672f7c78764', 'volume_name': 'volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89735a3f-add7-47e5-8cb0-25cb85cf87a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89735a3f-add7-47e5-8cb0-25cb85cf87a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876bbf98-6737-44bb-a689-099df4139afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Volume eb4ae8e3-a21b-46a1-8774-3672f7c78764: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:40:49 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Trying to clone eb4ae8e3-a21b-46a1-8774-3672f7c78764 from image ea19a761-954a-4f28-b989-b2705e0735e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:40:50 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fae079-8db1-458f-8f47-71001d4ae1c9]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:50 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd 1073741824" returned: 0 in 0.730s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:50 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd Jul 30 16:40:50 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:50 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD Jul 30 16:40:50 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:50 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd" returned: 0 in 0.330s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:50 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Temporary image ea19a761-954a-4f28-b989-b2705e0735e6 is fetched for user e976947aadab46e9bb191ae2d9869d2e. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583fe621-1817-4b2b-a336-3cb002b8a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2e3a9c-cee3-41ca-be09-2139fc23ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:50 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Volume volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd (89cd3835-40ce-49d0-9fc5-2218f3acf4fd): created successfully Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2e3a9c-cee3-41ca-be09-2139fc23ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Flow 'volume_create_manager' (963de85a-4545-4b93-a40d-afb617511a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b8a5e71d-fdc4-4409-8290-ea1f9b381497 tempest-ProjectReaderTests-79530553 None] Created volume successfully. Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c189a94-e959-4ff0-a32b-285f319fec89]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:51 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD Jul 30 16:40:51 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:51 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1993374967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4ae8e3-a21b-46a1-8774-3672f7c78764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446c3121eace4fa2a6b5d6c44a28d256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:49Z,use_quota=True,user_id='e976947aadab46e9bb191ae2d9869d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Creating volume eb4ae8e3-a21b-46a1-8774-3672f7c78764 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:51 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:51 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 1073741824 Jul 30 16:40:51 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Acquiring lock "cinder-89cd3835-40ce-49d0-9fc5-2218f3acf4fd-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Lock "cinder-89cd3835-40ce-49d0-9fc5-2218f3acf4fd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Acquiring lock "cinder-quobyte-89cd3835-40ce-49d0-9fc5-2218f3acf4fd" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Lock "cinder-quobyte-89cd3835-40ce-49d0-9fc5-2218f3acf4fd" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb4e7b6-3669-42b8-be81-4bf638780865]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:51 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 1073741824" returned: 0 in 0.525s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:51 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 Jul 30 16:40:51 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:51 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd Jul 30 16:40:51 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:52 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764" returned: 0 in 0.245s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:52 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Attempting download of ea19a761-954a-4f28-b989-b2705e0735e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}])) to volume eb4ae8e3-a21b-46a1-8774-3672f7c78764. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd" returned: 0 in 0.372s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:52 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd Jul 30 16:40:52 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa9f00b-1c70-4af1-8752-c8bde8f5f1cf]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_g6nt5r1h {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:52 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_g6nt5r1h Jul 30 16:40:52 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:52 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-89cd3835-40ce-49d0-9fc5-2218f3acf4fd" returned: 0 in 0.299s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Lock "cinder-quobyte-89cd3835-40ce-49d0-9fc5-2218f3acf4fd" released by "delete_volume" :: held 0.722s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Created reservations ['180435c4-0a18-498c-b895-13936e4c60d0', '3c32b7bb-7609-4d6a-9adb-075a3c681974', 'c3aec3af-1b3c-4b2d-ba35-bc10efe12815', 'b7948859-5699-42eb-8cf7-25fe378e818e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:52 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_g6nt5r1h" returned: 0 in 0.410s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_g6nt5r1h {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:52 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:52 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:52 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_g6nt5r1h Jul 30 16:40:52 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:52 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.301s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:52 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Deleted volume successfully. Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8c2518bf-69fd-45b0-8a92-603de6c76558 tempest-ProjectReaderTests-79530553 None] Lock "cinder-89cd3835-40ce-49d0-9fc5-2218f3acf4fd-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:53 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_g6nt5r1h" returned: 1 in 0.382s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_g6nt5r1h' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28f66a0-d473-403c-ba8b-9d53cc14e554]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:53 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD Jul 30 16:40:53 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:53 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] ea19a761-954a-4f28-b989-b2705e0735e6 was qcow2, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:53 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 Jul 30 16:40:53 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Flow 'volume_create_manager' (c09b99a7-7773-4876-8bf6-519b6b084376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29eb3511-3df9-46dc-ac74-7918b8908106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29eb3511-3df9-46dc-ac74-7918b8908106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-969472976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806535fd-97e1-4f51-ad9c-dad2dcafba68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f4df7040e24720acf57c1f46130b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:53Z,use_quota=True,user_id='4070bc594a1e4c7298abbf242b81e403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656a04c1-9859-4596-b068-9a221afc6d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656a04c1-9859-4596-b068-9a221afc6d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a890ef-40d0-4822-b10f-3033789cb783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a890ef-40d0-4822-b10f-3033789cb783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806535fd-97e1-4f51-ad9c-dad2dcafba68', 'volume_name': 'volume-806535fd-97e1-4f51-ad9c-dad2dcafba68', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b19fb23-06ca-48b1-a08a-691f0e81ad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b19fb23-06ca-48b1-a08a-691f0e81ad8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0cea49b-856e-473b-a84f-af3ebda07061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Volume 806535fd-97e1-4f51-ad9c-dad2dcafba68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806535fd-97e1-4f51-ad9c-dad2dcafba68', 'volume_size': 1} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-969472976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806535fd-97e1-4f51-ad9c-dad2dcafba68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f4df7040e24720acf57c1f46130b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:53Z,use_quota=True,user_id='4070bc594a1e4c7298abbf242b81e403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Creating volume 806535fd-97e1-4f51-ad9c-dad2dcafba68 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:53 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:40:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:53 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 1073741824 Jul 30 16:40:53 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:54 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 1073741824" returned: 0 in 0.495s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:54 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 Jul 30 16:40:54 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:54 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68" returned: 0 in 0.331s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0cea49b-856e-473b-a84f-af3ebda07061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806535fd-97e1-4f51-ad9c-dad2dcafba68', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3670d50b-2b9b-4a05-8879-fb8641258210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:54 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Volume volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 (806535fd-97e1-4f51-ad9c-dad2dcafba68): created successfully Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3670d50b-2b9b-4a05-8879-fb8641258210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Flow 'volume_create_manager' (c09b99a7-7773-4876-8bf6-519b6b084376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-93e5c1f7-fa81-4a24-8549-d733bea71b3c tempest-ProjectReaderTests-79530553 None] Created volume successfully. Jul 30 16:40:55 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764" returned: 0 in 1.991s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_cas5sf3tdevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:40:55 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Converted 112.00 MB image at 56.23 MB/s Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:55 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 1G Jul 30 16:40:55 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Acquiring lock "cinder-806535fd-97e1-4f51-ad9c-dad2dcafba68-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Lock "cinder-806535fd-97e1-4f51-ad9c-dad2dcafba68-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Acquiring lock "cinder-quobyte-806535fd-97e1-4f51-ad9c-dad2dcafba68" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Lock "cinder-quobyte-806535fd-97e1-4f51-ad9c-dad2dcafba68" acquired by "delete_volume" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfcc381-d2aa-42b9-9ee6-556078e993f4]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:55 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 Jul 30 16:40:55 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:55 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 1G" returned: 0 in 0.415s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Downloaded image ea19a761-954a-4f28-b989-b2705e0735e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}])) to volume eb4ae8e3-a21b-46a1-8774-3672f7c78764 successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Temporary image ea19a761-954a-4f28-b989-b2705e0735e6 for user e976947aadab46e9bb191ae2d9869d2e is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Marking volume eb4ae8e3-a21b-46a1-8774-3672f7c78764 as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Copying metadata from image ea19a761-954a-4f28-b989-b2705e0735e6 to eb4ae8e3-a21b-46a1-8774-3672f7c78764. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:40:55 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Creating volume glance metadata for volume eb4ae8e3-a21b-46a1-8774-3672f7c78764 backed by image ea19a761-954a-4f28-b989-b2705e0735e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876bbf98-6737-44bb-a689-099df4139afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d18eda-6acd-4c06-9d5a-666cef803bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:56 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Volume volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 (eb4ae8e3-a21b-46a1-8774-3672f7c78764): created successfully Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d18eda-6acd-4c06-9d5a-666cef803bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Flow 'volume_create_manager' (ed4b9810-4e61-4885-b996-c1503f88f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d1f10387-2f36-49b1-93e4-620eaff906b6 tempest-TestShelveInstance-1989878917 None] Created volume successfully. Jul 30 16:40:56 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68" returned: 0 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:56 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68 Jul 30 16:40:56 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:56 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-806535fd-97e1-4f51-ad9c-dad2dcafba68" returned: 0 in 0.247s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Lock "cinder-quobyte-806535fd-97e1-4f51-ad9c-dad2dcafba68" released by "delete_volume" :: held 0.702s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Created reservations ['a788a89e-0aee-4664-9443-1fc7f02a50be', '9d2b30bc-4eb2-4ede-ba6d-2efd54d134b1', '4d5dfae5-a660-430b-9e02-1652f920a220', '6fe6ad5a-8260-4f19-8c5d-a0ad19338828'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:56 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:40:56 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:56 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.271s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Deleted volume successfully. Jul 30 16:40:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6bc70dc2-8b63-4ebc-92ba-d0cb91667a0c tempest-ProjectReaderTests-79530553 None] Lock "cinder-806535fd-97e1-4f51-ad9c-dad2dcafba68-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-3a82e432-f3a3-4819-b72f-d813b16842f3 req-b66840f1-da80-43d5-8fa8-2d494fcf7bcf tempest-TestShelveInstance-1989878917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-3a82e432-f3a3-4819-b72f-d813b16842f3 req-b66840f1-da80-43d5-8fa8-2d494fcf7bcf tempest-TestShelveInstance-1989878917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-3a82e432-f3a3-4819-b72f-d813b16842f3 req-b66840f1-da80-43d5-8fa8-2d494fcf7bcf tempest-TestShelveInstance-1989878917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-3a82e432-f3a3-4819-b72f-d813b16842f3 req-b66840f1-da80-43d5-8fa8-2d494fcf7bcf tempest-TestShelveInstance-1989878917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29125f42-56af-4ee7-ae0f-31ed91b65f32', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:40:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-3a82e432-f3a3-4819-b72f-d813b16842f3 req-b66840f1-da80-43d5-8fa8-2d494fcf7bcf tempest-TestShelveInstance-1989878917 None] attachment_update completed successfully. Jul 30 16:41:09 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=51,cinder:SELECT=57,cinder:DELETE=4,cinder:INSERT=17 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:41:09 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=50,cinder:UPDATE=58,cinder:INSERT=18,cinder:DELETE=6 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:41:21 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:41:21 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Flow 'volume_create_manager' (3a82c786-3b53-456a-9b88-a0055d8140dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9532d8-c96c-4c74-a66d-e45df80c325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9532d8-c96c-4c74-a66d-e45df80c325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1018739870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe21be9-6ac6-4d0b-a56c-2220f7095787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f67128549f4dd08cb177f8025fa595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:27Z,use_quota=True,user_id='6fc6f2de2f0149d391bfa10af1102389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a69e49f-8505-4c2e-aa3f-0114831d76ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a69e49f-8505-4c2e-aa3f-0114831d76ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b7cf5d-aa50-42f6-9555-bc19100d1a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b7cf5d-aa50-42f6-9555-bc19100d1a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe21be9-6ac6-4d0b-a56c-2220f7095787', 'volume_name': 'volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dd7df8-0326-405d-b1ae-6e33d9ed5782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dd7df8-0326-405d-b1ae-6e33d9ed5782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bfd59c-d146-485d-b22b-7d3d569b15e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:26 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Volume bbe21be9-6ac6-4d0b-a56c-2220f7095787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787', 'volume_size': 1} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1018739870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe21be9-6ac6-4d0b-a56c-2220f7095787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f67128549f4dd08cb177f8025fa595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:27Z,use_quota=True,user_id='6fc6f2de2f0149d391bfa10af1102389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Creating volume bbe21be9-6ac6-4d0b-a56c-2220f7095787 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:41:26 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:41:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:27 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 1073741824 Jul 30 16:41:27 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:27 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 1073741824" returned: 0 in 0.388s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:27 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 Jul 30 16:41:27 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:27 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787" returned: 0 in 0.242s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bfd59c-d146-485d-b22b-7d3d569b15e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85010054-1bb6-4bf7-a16d-e694823f66d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:27 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Volume volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 (bbe21be9-6ac6-4d0b-a56c-2220f7095787): created successfully Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85010054-1bb6-4bf7-a16d-e694823f66d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Flow 'volume_create_manager' (3a82c786-3b53-456a-9b88-a0055d8140dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d187dfef-3be7-41df-bd1b-20d250a39938 tempest-AttachVolumeNegativeTest-2093205215 None] Created volume successfully. Jul 30 16:41:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2581aaf3-5853-491e-ad9a-39993d1eafd5 req-5adfbcb5-95a9-4f2e-8930-62d1cc350366 tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2581aaf3-5853-491e-ad9a-39993d1eafd5 req-5adfbcb5-95a9-4f2e-8930-62d1cc350366 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-2581aaf3-5853-491e-ad9a-39993d1eafd5 req-5adfbcb5-95a9-4f2e-8930-62d1cc350366 tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-2581aaf3-5853-491e-ad9a-39993d1eafd5 req-5adfbcb5-95a9-4f2e-8930-62d1cc350366 tempest-AttachVolumeNegativeTest-2093205215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abea1ed3-c024-416a-98f7-8d5c7b0694ef', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:41:28 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-2581aaf3-5853-491e-ad9a-39993d1eafd5 req-5adfbcb5-95a9-4f2e-8930-62d1cc350366 tempest-AttachVolumeNegativeTest-2093205215 None] attachment_update completed successfully. Jul 30 16:41:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-d32a9c3a-a64a-471c-8d86-9531ee4d5442 req-514527c7-dcd3-4faa-b13f-9c198501c8b9 tempest-AttachVolumeNegativeTest-2093205215 None] Terminate volume connection completed successfully. Jul 30 16:41:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-d32a9c3a-a64a-471c-8d86-9531ee4d5442 req-514527c7-dcd3-4faa-b13f-9c198501c8b9 tempest-AttachVolumeNegativeTest-2093205215 None] Deleting attachment abea1ed3-c024-416a-98f7-8d5c7b0694ef. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:41:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-0fa99185-5726-471c-adb1-f63d712e79f2 req-868f2bf6-831a-469b-8f7c-2dd3551e5e64 tempest-TestShelveInstance-1989878917 None] Terminate volume connection completed successfully. Jul 30 16:41:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-0fa99185-5726-471c-adb1-f63d712e79f2 req-868f2bf6-831a-469b-8f7c-2dd3551e5e64 tempest-TestShelveInstance-1989878917 None] Deleting attachment 29125f42-56af-4ee7-ae0f-31ed91b65f32. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "cinder-bbe21be9-6ac6-4d0b-a56c-2220f7095787-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-bbe21be9-6ac6-4d0b-a56c-2220f7095787-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "cinder-quobyte-bbe21be9-6ac6-4d0b-a56c-2220f7095787" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-quobyte-bbe21be9-6ac6-4d0b-a56c-2220f7095787" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[14821aee-725e-481c-a346-cd473f5b45c7]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:35 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 Jul 30 16:41:35 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:35 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787" returned: 0 in 0.407s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:35 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787 Jul 30 16:41:35 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-a3b781dc-03bd-45ab-99fd-0bf30eb0a0e5 req-6b4e4e31-e620-4200-b263-7d8233ca44b1 tempest-TestShelveInstance-1989878917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-a3b781dc-03bd-45ab-99fd-0bf30eb0a0e5 req-6b4e4e31-e620-4200-b263-7d8233ca44b1 tempest-TestShelveInstance-1989878917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-a3b781dc-03bd-45ab-99fd-0bf30eb0a0e5 req-6b4e4e31-e620-4200-b263-7d8233ca44b1 tempest-TestShelveInstance-1989878917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-a3b781dc-03bd-45ab-99fd-0bf30eb0a0e5 req-6b4e4e31-e620-4200-b263-7d8233ca44b1 tempest-TestShelveInstance-1989878917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e49e712b-b664-42ca-ae81-21350586e61e', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:41:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-a3b781dc-03bd-45ab-99fd-0bf30eb0a0e5 req-6b4e4e31-e620-4200-b263-7d8233ca44b1 tempest-TestShelveInstance-1989878917 None] attachment_update completed successfully. Jul 30 16:41:35 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-bbe21be9-6ac6-4d0b-a56c-2220f7095787" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-quobyte-bbe21be9-6ac6-4d0b-a56c-2220f7095787" released by "delete_volume" :: held 0.738s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:35 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Created reservations ['9debff17-ec9e-46d9-a1c7-a787b041b596', '3bf4df49-2edb-4078-9212-5cf00927e4c8', 'bb9da422-51e3-49f1-acb0-587c4d8f69c9', 'bea655b1-a3af-4a00-a90a-48f27b6b5d3a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:36 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:41:36 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:36 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.277s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Deleted volume successfully. Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-bdb690b9-7647-4e59-a388-bbe9b61e467d tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-bbe21be9-6ac6-4d0b-a56c-2220f7095787-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "cinder-dea89e8b-ce28-4392-99e3-1a2947185a3d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-dea89e8b-ce28-4392-99e3-1a2947185a3d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "cinder-quobyte-dea89e8b-ce28-4392-99e3-1a2947185a3d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-quobyte-dea89e8b-ce28-4392-99e3-1a2947185a3d" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c02db97-4580-42fc-90be-cd6f0be1060c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:36 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d Jul 30 16:41:36 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:36 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d" returned: 0 in 0.437s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:36 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d Jul 30 16:41:36 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:37 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dea89e8b-ce28-4392-99e3-1a2947185a3d" returned: 0 in 0.264s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-quobyte-dea89e8b-ce28-4392-99e3-1a2947185a3d" released by "delete_volume" :: held 0.749s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Created reservations ['de8455b6-247b-4e59-aa50-e2e9414b28d7', 'a6d767bf-0e00-4cd3-8ca4-49d1fae17903', 'a23058ac-d819-4af1-b96e-48673b096e02', '3a3a8df3-89ef-4419-8eea-485c3a1a735a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:37 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:41:37 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:37 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.282s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Deleted volume successfully. Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-afb9be33-4665-4189-8047-7692f13817ab tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-dea89e8b-ce28-4392-99e3-1a2947185a3d-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "cinder-e04efe89-2b5f-4a6f-9a3f-b68356898ca5-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-e04efe89-2b5f-4a6f-9a3f-b68356898ca5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "cinder-quobyte-e04efe89-2b5f-4a6f-9a3f-b68356898ca5" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-quobyte-e04efe89-2b5f-4a6f-9a3f-b68356898ca5" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[571899b5-688c-4b37-a4a5-155a85b26499]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:37 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 Jul 30 16:41:37 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:38 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5" returned: 0 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:38 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5 Jul 30 16:41:38 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:38 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e04efe89-2b5f-4a6f-9a3f-b68356898ca5" returned: 0 in 0.468s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-quobyte-e04efe89-2b5f-4a6f-9a3f-b68356898ca5" released by "delete_volume" :: held 0.915s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:38 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Created reservations ['4f2993de-e6d9-45b0-a9d4-b510a309a035', '30a44af9-0f9e-4189-ba20-6f0638a4f862', '1fcf13a1-5b4d-4978-a588-a80c46a89d93', 'ffcc8ff9-6654-4085-b54e-e0bec954d0b3'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:39 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:41:39 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:39 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.335s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:39 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Deleted volume successfully. Jul 30 16:41:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-10ea343f-3b33-40da-89ac-e3c9c4c3fb0b tempest-AttachVolumeNegativeTest-2093205215 None] Lock "cinder-e04efe89-2b5f-4a6f-9a3f-b68356898ca5-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8453884f-a29d-43b5-95d7-25909a1b50f0 tempest-GroupSnapshotsV319Test-1192679402 None] Group tempest-GroupSnapshotsV319Test-Group-1508305579: creating Jul 30 16:41:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8453884f-a29d-43b5-95d7-25909a1b50f0 tempest-GroupSnapshotsV319Test-1192679402 None] Group tempest-GroupSnapshotsV319Test-Group-1508305579: created successfully Jul 30 16:41:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8453884f-a29d-43b5-95d7-25909a1b50f0 tempest-GroupSnapshotsV319Test-1192679402 None] Create group completed successfully. Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:47 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:41:47 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:47 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.262s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:41:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Flow 'volume_create_manager' (14bc269c-ccc1-4373-a00a-fb0ae44285d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c831d720-44f2-4e95-ba99-7f0445390ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c831d720-44f2-4e95-ba99-7f0445390ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-898948130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3d537a7-4499-4128-bc2f-ecde0446a952,host='devstack@QuobyteHD#QuobyteHD',id=2ff99709-7972-4dca-b370-46610a82bdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3e8afe314f431eb2fe7e2b5d7fda71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:49Z,use_quota=True,user_id='b5c582247b184057b00edbb41ae75e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f77b523d-cdc6-4bf5-b865-8ec7c34bef7c),volume_type_id=f77b523d-cdc6-4bf5-b865-8ec7c34bef7c)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f738bd23-9bdb-4063-ae2e-8f121515482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f738bd23-9bdb-4063-ae2e-8f121515482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a057d1-32ce-45ed-bf7b-b6f9fc09865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a057d1-32ce-45ed-bf7b-b6f9fc09865d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff99709-7972-4dca-b370-46610a82bdd3', 'volume_name': 'volume-2ff99709-7972-4dca-b370-46610a82bdd3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7516a52b-52e7-42af-b3a8-dd8f320bb985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7516a52b-52e7-42af-b3a8-dd8f320bb985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6951938c-6022-4f05-8469-2dd43d59fa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:48 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Volume 2ff99709-7972-4dca-b370-46610a82bdd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff99709-7972-4dca-b370-46610a82bdd3', 'volume_size': 1} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f3d537a7-4499-4128-bc2f-ecde0446a952,created_at=2026-07-30T14:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-898948130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3d537a7-4499-4128-bc2f-ecde0446a952,host='devstack@QuobyteHD#QuobyteHD',id=2ff99709-7972-4dca-b370-46610a82bdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e3e8afe314f431eb2fe7e2b5d7fda71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:49Z,use_quota=True,user_id='b5c582247b184057b00edbb41ae75e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f77b523d-cdc6-4bf5-b865-8ec7c34bef7c),volume_type_id=f77b523d-cdc6-4bf5-b865-8ec7c34bef7c)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Creating volume 2ff99709-7972-4dca-b370-46610a82bdd3 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:41:48 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:41:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:48 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 1073741824 Jul 30 16:41:48 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:49 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 1073741824" returned: 0 in 0.402s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:49 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 Jul 30 16:41:49 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:49 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3" returned: 0 in 0.256s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6951938c-6022-4f05-8469-2dd43d59fa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff99709-7972-4dca-b370-46610a82bdd3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5c71c5-a9b1-48d8-b080-d232b3a80e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Volume volume-2ff99709-7972-4dca-b370-46610a82bdd3 (2ff99709-7972-4dca-b370-46610a82bdd3): created successfully Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5c71c5-a9b1-48d8-b080-d232b3a80e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Flow 'volume_create_manager' (14bc269c-ccc1-4373-a00a-fb0ae44285d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c75543b1-8751-4516-b132-43bcd0b6cdea tempest-GroupSnapshotsV319Test-1192679402 None] Created volume successfully. Jul 30 16:41:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] GroupSnapshot 16188ddc-2b8e-4f32-9c29-0a44bc416483: creating. Jul 30 16:41:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Group snapshot 16188ddc-2b8e-4f32-9c29-0a44bc416483: creating. {{(pid=88095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:41:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Creating offline snapshot a1c1725d-88c6-43f3-843a-a51cf75eb61b of volume 2ff99709-7972-4dca-b370-46610a82bdd3 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:41:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce8ee2-a0c6-4455-9371-bb707350d16b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:50 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 Jul 30 16:41:50 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:50 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:50 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b 1G Jul 30 16:41:50 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:51 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b 1G" returned: 0 in 0.388s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff99709-7972-4dca-b370-46610a82bdd3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:51 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff99709-7972-4dca-b370-46610a82bdd3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b Jul 30 16:41:51 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:51 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ff99709-7972-4dca-b370-46610a82bdd3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b" returned: 0 in 0.298s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:51 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:41:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:51 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b Jul 30 16:41:51 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:51 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b" returned: 0 in 0.249s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:51 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.info Jul 30 16:41:51 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:51 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.info" returned: 0 in 0.256s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:51 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:41:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:51 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.info Jul 30 16:41:51 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:52 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.info" returned: 0 in 0.241s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d8caa57a-e6d2-45ff-897d-4bb6817cc0ae tempest-GroupSnapshotsV319Test-1192679402 None] group_snapshot 16188ddc-2b8e-4f32-9c29-0a44bc416483: created successfully Jul 30 16:41:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] group_snapshot 16188ddc-2b8e-4f32-9c29-0a44bc416483: deleting Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] group_snapshot 16188ddc-2b8e-4f32-9c29-0a44bc416483: deleting {{(pid=88095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Acquiring lock "cinder-quobyte-2ff99709-7972-4dca-b370-46610a82bdd3" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Lock "cinder-quobyte-2ff99709-7972-4dca-b370-46610a82bdd3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Acquiring lock "cinder-quobyte-a1c1725d-88c6-43f3-843a-a51cf75eb61b" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Lock "cinder-quobyte-a1c1725d-88c6-43f3-843a-a51cf75eb61b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Deleting offline snapshot a1c1725d-88c6-43f3-843a-a51cf75eb61b of volume 2ff99709-7972-4dca-b370-46610a82bdd3 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] snapshot_file for this snap is: volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[53703c61-b4d7-49f4-9ceb-06fe33df5aef]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:53 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b Jul 30 16:41:53 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:53 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b" returned: 0 in 0.360s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ff99709-7972-4dca-b370-46610a82bdd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:41:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cad6268-3cd7-494d-acf5-1d01029ce8a6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:53 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 Jul 30 16:41:53 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:53 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3" returned: 0 in 0.372s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:53 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b Jul 30 16:41:53 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:54 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b" returned: 0 in 0.364s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:54 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b Jul 30 16:41:54 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:54 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3.a1c1725d-88c6-43f3-843a-a51cf75eb61b" returned: 0 in 0.253s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Lock "cinder-quobyte-a1c1725d-88c6-43f3-843a-a51cf75eb61b" released by "_delete_snapshot" :: held 1.442s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Lock "cinder-quobyte-2ff99709-7972-4dca-b370-46610a82bdd3" released by "delete_snapshot" :: held 1.473s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:54 devstack cinder-volume[88095]: WARNING cinder.quota [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1736473545 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1736473545, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:41:54 devstack cinder-volume[88095]: WARNING cinder.quota [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1736473545 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1736473545, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:41:54 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] Created reservations ['4c514f05-3c65-4442-b7d9-e4815507e7d1', 'e2ff17d1-636d-4c97-8164-5d291d76c78e', '9a830198-1664-4949-91cd-b172340224a1', '957da5f8-a8b3-48a9-9d93-81f6b2cbc117'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-36f1835f-2645-42c9-b48c-9f587e02fb3e tempest-GroupSnapshotsV319Test-1192679402 None] group_snapshot 16188ddc-2b8e-4f32-9c29-0a44bc416483: deleted successfully Jul 30 16:41:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Acquiring lock "cinder-quobyte-2ff99709-7972-4dca-b370-46610a82bdd3" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Lock "cinder-quobyte-2ff99709-7972-4dca-b370-46610a82bdd3" acquired by "delete_volume" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:55 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a886f88-1df1-4f77-94bd-2d8d6dcc77bd]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:55 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 Jul 30 16:41:55 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:55 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3" returned: 0 in 0.369s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:55 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3 Jul 30 16:41:55 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:56 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2ff99709-7972-4dca-b370-46610a82bdd3" returned: 0 in 0.245s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Lock "cinder-quobyte-2ff99709-7972-4dca-b370-46610a82bdd3" released by "delete_volume" :: held 0.675s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Created reservations ['929bcb96-7915-44a7-b17e-a23b39e80d56'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:56 devstack cinder-volume[88095]: WARNING cinder.quota [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1736473545 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1736473545, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Created reservations ['f2a5a5bc-34eb-4f6a-a0cf-036be5c07a1a', '610cd0a7-22a3-4ffe-8830-a86e8fda17a1', '99d96b8b-1a5c-4b74-8cf6-0bd24e594ea3', 'd52bb380-3a4b-4378-931e-0a40516fe865'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:56 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:41:56 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:56 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.240s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:56 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ef4804dc-f33d-4140-95be-7cf692c2d371 tempest-GroupSnapshotsV319Test-1192679402 None] Delete group completed successfully. Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=51,cinder:UPDATE=51,cinder:INSERT=11,cinder:DELETE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=62,cinder:UPDATE=55,cinder:INSERT=13,cinder:DELETE=4 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Flow 'volume_create_manager' (e53955da-7ae1-45d7-9d7b-d80605b511da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845a1a41-cb09-49cb-80bd-dcca97d1c453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845a1a41-cb09-49cb-80bd-dcca97d1c453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-576335278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed47135a-7f3d-4ee2-91d3-29e266a05986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62000c4464394b28879edc8197c4f9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:06Z,use_quota=True,user_id='e6706154d8f0498da6f7fd71632a61fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1392f20-4083-4ccc-8b06-6ecbbf2b16ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1392f20-4083-4ccc-8b06-6ecbbf2b16ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c71c661-89b3-4d90-b571-dfd43f9c2bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c71c661-89b3-4d90-b571-dfd43f9c2bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed47135a-7f3d-4ee2-91d3-29e266a05986', 'volume_name': 'volume-ed47135a-7f3d-4ee2-91d3-29e266a05986', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591820c4-c346-46dc-89d1-c204e1541e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591820c4-c346-46dc-89d1-c204e1541e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523b4856-c99e-455a-b43b-72e13d0c18ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:06 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Volume ed47135a-7f3d-4ee2-91d3-29e266a05986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed47135a-7f3d-4ee2-91d3-29e266a05986', 'volume_size': 1} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-576335278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed47135a-7f3d-4ee2-91d3-29e266a05986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62000c4464394b28879edc8197c4f9ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:06Z,use_quota=True,user_id='e6706154d8f0498da6f7fd71632a61fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Creating volume ed47135a-7f3d-4ee2-91d3-29e266a05986 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:42:06 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:42:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:06 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 1073741824 Jul 30 16:42:06 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:07 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 1073741824" returned: 0 in 0.500s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:07 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 Jul 30 16:42:07 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:07 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986" returned: 0 in 0.262s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523b4856-c99e-455a-b43b-72e13d0c18ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed47135a-7f3d-4ee2-91d3-29e266a05986', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f417ae2-b773-4162-857e-dce89941f69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:07 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Volume volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 (ed47135a-7f3d-4ee2-91d3-29e266a05986): created successfully Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f417ae2-b773-4162-857e-dce89941f69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Flow 'volume_create_manager' (e53955da-7ae1-45d7-9d7b-d80605b511da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f947a1b6-ba48-42ee-aec2-2521aea1f9cd tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Created volume successfully. Jul 30 16:42:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-45fd77c5-ae36-4368-bd41-6a1f5bf2856d tempest-TestShelveInstance-1989878917 None] Terminate volume connection completed successfully. Jul 30 16:42:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-45fd77c5-ae36-4368-bd41-6a1f5bf2856d tempest-TestShelveInstance-1989878917 None] Deleting attachment e49e712b-b664-42ca-ae81-21350586e61e. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Acquiring lock "cinder-eb4ae8e3-a21b-46a1-8774-3672f7c78764-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Lock "cinder-eb4ae8e3-a21b-46a1-8774-3672f7c78764-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Acquiring lock "cinder-quobyte-eb4ae8e3-a21b-46a1-8774-3672f7c78764" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Lock "cinder-quobyte-eb4ae8e3-a21b-46a1-8774-3672f7c78764" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf6e22-25f1-4e8b-a748-c14c71490df0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:08 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 Jul 30 16:42:08 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:08 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764" returned: 0 in 0.390s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:08 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764 Jul 30 16:42:08 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:08 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eb4ae8e3-a21b-46a1-8774-3672f7c78764" returned: 0 in 0.269s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Lock "cinder-quobyte-eb4ae8e3-a21b-46a1-8774-3672f7c78764" released by "delete_volume" :: held 0.703s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG cinder.quota [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Created reservations ['c044e65e-9bd1-416e-9500-4eb1e33bc22a', '5e6dda6e-a051-407c-bbf8-4cab115a83d3', 'bf738c3d-e983-44a0-b0b3-8b47a63a1328', '559e5f7e-5259-4a2a-b168-538fe2dc3d66'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:08 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:42:08 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:09 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.237s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG cinder.manager [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:42:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Deleted volume successfully. Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [req-7f779746-f48e-4ff2-80f2-89cef58d0cb9 req-82f49da6-84ba-40f9-8ced-2fc13bf1b779 tempest-TestShelveInstance-1989878917 None] Lock "cinder-eb4ae8e3-a21b-46a1-8774-3672f7c78764-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Acquiring lock "cinder-ed47135a-7f3d-4ee2-91d3-29e266a05986-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "cinder-ed47135a-7f3d-4ee2-91d3-29e266a05986-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Acquiring lock "cinder-quobyte-ed47135a-7f3d-4ee2-91d3-29e266a05986" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "cinder-quobyte-ed47135a-7f3d-4ee2-91d3-29e266a05986" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a4dc5a-f275-4f0e-a13b-1c3f5afda812]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:09 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 Jul 30 16:42:09 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:10 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986" returned: 0 in 0.392s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:10 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986 Jul 30 16:42:10 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:10 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ed47135a-7f3d-4ee2-91d3-29e266a05986" returned: 0 in 0.258s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "cinder-quobyte-ed47135a-7f3d-4ee2-91d3-29e266a05986" released by "delete_volume" :: held 0.693s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Created reservations ['e19d1ac4-2e4f-47e1-ac6a-3e06e66e509e', 'd6153363-ddc0-407d-9129-564543b36da7', '50e569f9-f8ea-4b73-ad69-07741f356829', '75b4bde3-f8de-4228-8f56-2675240abf8b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:10 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:42:10 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:10 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.336s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:42:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Deleted volume successfully. Jul 30 16:42:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-43aa2f0c-35fb-49b1-9d42-7ba4479764e4 tempest-VolumeQuotasNegativeTestJSON-1680136914 None] Lock "cinder-ed47135a-7f3d-4ee2-91d3-29e266a05986-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:16 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:42:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Flow 'volume_create_manager' (abf28518-67c5-4c62-a4aa-d77083b547e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9544b4-137b-40dc-853b-735a102e7613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9544b4-137b-40dc-853b-735a102e7613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-505632007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e313c93-1de8-47a4-aeeb-4bde56af4de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f783eff9db4942d58cb9c263f09dd83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:17Z,use_quota=True,user_id='949a44c32f8f4e26a0d429d9a0b3acc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c032dc-b36e-4ee0-b248-b771c5185f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c032dc-b36e-4ee0-b248-b771c5185f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f575f327-c84a-4a22-8bdf-8081f2c38a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f575f327-c84a-4a22-8bdf-8081f2c38a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e313c93-1de8-47a4-aeeb-4bde56af4de7', 'volume_name': 'volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ade2d52-552f-49bf-be81-452c5c6e6b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ade2d52-552f-49bf-be81-452c5c6e6b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76dec46-8d4c-41f9-acf7-fde73cc68980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:17 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Volume 9e313c93-1de8-47a4-aeeb-4bde56af4de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7', 'volume_size': 1} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-505632007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e313c93-1de8-47a4-aeeb-4bde56af4de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f783eff9db4942d58cb9c263f09dd83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:17Z,use_quota=True,user_id='949a44c32f8f4e26a0d429d9a0b3acc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Creating volume 9e313c93-1de8-47a4-aeeb-4bde56af4de7 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:42:17 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:17 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 1073741824 Jul 30 16:42:17 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:17 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 1073741824" returned: 0 in 0.525s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:17 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 Jul 30 16:42:17 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:17 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7" returned: 0 in 0.283s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76dec46-8d4c-41f9-acf7-fde73cc68980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4113056-7af4-45ff-8580-387c2ae38611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:17 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Volume volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 (9e313c93-1de8-47a4-aeeb-4bde56af4de7): created successfully Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4113056-7af4-45ff-8580-387c2ae38611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Flow 'volume_create_manager' (abf28518-67c5-4c62-a4aa-d77083b547e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-08c41f46-9ebd-4309-91e6-a7b7b285abee tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Created volume successfully. Jul 30 16:42:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Creating offline snapshot 054ee3d0-b091-44ba-9468-3a88433acb4f of volume 9e313c93-1de8-47a4-aeeb-4bde56af4de7 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:42:19 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[77342c27-25b3-43e2-9156-3fd7e37077ea]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:19 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 Jul 30 16:42:19 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:19 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7" returned: 0 in 0.421s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:19 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f 1G Jul 30 16:42:19 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:20 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f 1G" returned: 0 in 0.441s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:20 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f Jul 30 16:42:20 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:20 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f" returned: 0 in 0.298s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:20 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f is being set with open permissions: ugo+rw Jul 30 16:42:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:20 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f Jul 30 16:42:20 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:20 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f" returned: 0 in 0.243s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:20 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.info Jul 30 16:42:20 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:20 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.info" returned: 0 in 0.241s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:20 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.info is being set with open permissions: ugo+rw Jul 30 16:42:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:20 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.info Jul 30 16:42:20 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:21 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.info" returned: 0 in 0.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:21 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-018a4250-9a4c-436c-8fa8-b51e1acceaf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Create snapshot completed successfully Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "cinder-054ee3d0-b091-44ba-9468-3a88433acb4f-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-054ee3d0-b091-44ba-9468-3a88433acb4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "cinder-quobyte-9e313c93-1de8-47a4-aeeb-4bde56af4de7" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-quobyte-9e313c93-1de8-47a4-aeeb-4bde56af4de7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "cinder-quobyte-054ee3d0-b091-44ba-9468-3a88433acb4f" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-quobyte-054ee3d0-b091-44ba-9468-3a88433acb4f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Deleting offline snapshot 054ee3d0-b091-44ba-9468-3a88433acb4f of volume 9e313c93-1de8-47a4-aeeb-4bde56af4de7 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] snapshot_file for this snap is: volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9676f185-fdf8-4d5e-b747-aa116307c578]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:22 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f Jul 30 16:42:22 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:22 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f" returned: 0 in 0.412s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:42:22 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc61ad-c757-405d-9ff1-d06a6a7821be]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:22 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 Jul 30 16:42:22 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:22 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7" returned: 0 in 0.362s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:22 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f Jul 30 16:42:22 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:23 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f" returned: 0 in 0.380s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:23 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f Jul 30 16:42:23 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:23 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7.054ee3d0-b091-44ba-9468-3a88433acb4f" returned: 0 in 0.248s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-quobyte-054ee3d0-b091-44ba-9468-3a88433acb4f" released by "_delete_snapshot" :: held 1.517s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-quobyte-9e313c93-1de8-47a4-aeeb-4bde56af4de7" released by "delete_snapshot" :: held 1.545s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:23 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Created reservations ['62905b38-ff4e-4dce-94fc-afd671510cd9', '0dc0a055-c8e8-4944-91ff-03533059d209', '80c8b088-59cc-414f-a227-65ce60dc578b', '99efcdfe-1dcc-42c8-ba78-e7d85deb7a6c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:42:23 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Delete snapshot completed successfully. Jul 30 16:42:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4717e544-6686-4f7f-a227-362b28dbbd4a tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-054ee3d0-b091-44ba-9468-3a88433acb4f-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "cinder-9e313c93-1de8-47a4-aeeb-4bde56af4de7-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-9e313c93-1de8-47a4-aeeb-4bde56af4de7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "cinder-quobyte-9e313c93-1de8-47a4-aeeb-4bde56af4de7" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-quobyte-9e313c93-1de8-47a4-aeeb-4bde56af4de7" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[29117e2b-9960-44ec-9e90-570680c4942d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:24 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 Jul 30 16:42:24 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:24 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7" returned: 0 in 0.379s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:24 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7 Jul 30 16:42:24 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:24 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9e313c93-1de8-47a4-aeeb-4bde56af4de7" returned: 0 in 0.241s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-quobyte-9e313c93-1de8-47a4-aeeb-4bde56af4de7" released by "delete_volume" :: held 0.699s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Created reservations ['b4e50dd5-2b29-4027-83e2-3f94770c5520', 'bc48dbd6-393d-4a83-ab3f-078f3925c4df', '41d70c19-5b9b-4acd-bfa9-9a19557fbc21', '60686d22-51b0-41d4-9d7a-9ca86caa68c6'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:25 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:42:25 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:25 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.289s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:25 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:42:25 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Deleted volume successfully. Jul 30 16:42:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1b78fba7-6a11-42ba-a1af-3f82c18b6ab7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1437879721 None] Lock "cinder-9e313c93-1de8-47a4-aeeb-4bde56af4de7-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:34 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=31,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:35 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=34,cinder:DELETE=4 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Flow 'volume_create_manager' (96060f3b-9bee-4387-b8ff-3346bfce1c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fd09ba-f2c0-4492-9fe5-91020260d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fd09ba-f2c0-4492-9fe5-91020260d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-455997816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d693be0-a77c-4f0a-aa8d-71177ae5d012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82af2ef5ee5416295536116483b1a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:42Z,use_quota=True,user_id='31b3ac3699db4edaa5e98452a72a7c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ccdb7f-48aa-44b1-8938-1c651b4bc7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ccdb7f-48aa-44b1-8938-1c651b4bc7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0df8428-5106-42db-9b15-99da7193c202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0df8428-5106-42db-9b15-99da7193c202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d693be0-a77c-4f0a-aa8d-71177ae5d012', 'volume_name': 'volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217e2b6f-7cb8-4cd9-bed5-7f658b3ed3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217e2b6f-7cb8-4cd9-bed5-7f658b3ed3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e3be8e-4b13-49fa-8956-408a6139f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Volume 8d693be0-a77c-4f0a-aa8d-71177ae5d012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012', 'volume_size': 1} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-455997816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d693be0-a77c-4f0a-aa8d-71177ae5d012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82af2ef5ee5416295536116483b1a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:42Z,use_quota=True,user_id='31b3ac3699db4edaa5e98452a72a7c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Creating volume 8d693be0-a77c-4f0a-aa8d-71177ae5d012 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:42:41 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:42:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:41 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 1073741824 Jul 30 16:42:41 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:42 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 1073741824" returned: 0 in 0.444s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:42 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 Jul 30 16:42:42 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:42 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012" returned: 0 in 0.347s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e3be8e-4b13-49fa-8956-408a6139f90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df229c81-b43f-4133-930c-2c33c9c15e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:42 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Volume volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 (8d693be0-a77c-4f0a-aa8d-71177ae5d012): created successfully Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df229c81-b43f-4133-930c-2c33c9c15e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Flow 'volume_create_manager' (96060f3b-9bee-4387-b8ff-3346bfce1c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:42 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a21c78c5-05ac-4743-96d6-bd0b020fe05e tempest-TestImageHashVerification-1241600928 None] Created volume successfully. Jul 30 16:42:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:45 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[92663124-c98f-49ff-a28c-ae5ea9e7e108]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:45 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 Jul 30 16:42:45 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:45 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012" returned: 0 in 0.404s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:45 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a501a021-c89b-47e0-9401-76978c50ccf1]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:45 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 Jul 30 16:42:45 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:45 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012" returned: 0 in 0.391s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 /opt/stack/data/cinder/conversion/8d693be0-a77c-4f0a-aa8d-71177ae5d012.temp_image.1326c3df-aa56-4aac-875c-fb8b3994a88d7j3tiici.img {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:45 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 /opt/stack/data/cinder/conversion/8d693be0-a77c-4f0a-aa8d-71177ae5d012.temp_image.1326c3df-aa56-4aac-875c-fb8b3994a88d7j3tiici.img Jul 30 16:42:45 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:42:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:47 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:42:47 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:48 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.654s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:48 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:42:48 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:42:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:42:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:42:50 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 /opt/stack/data/cinder/conversion/8d693be0-a77c-4f0a-aa8d-71177ae5d012.temp_image.1326c3df-aa56-4aac-875c-fb8b3994a88d7j3tiici.img" returned: 0 in 4.599s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cce746-0f67-409d-a93d-4b7632121c38]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:50 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 Jul 30 16:42:50 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:51 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012" returned: 0 in 0.562s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:51 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/conversion/8d693be0-a77c-4f0a-aa8d-71177ae5d012.temp_image.1326c3df-aa56-4aac-875c-fb8b3994a88d7j3tiici.img {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:42:51 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Converted 1024.00 MB image at 222.63 MB/s Jul 30 16:42:51 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] 1326c3df-aa56-4aac-875c-fb8b3994a88d was raw, no need to convert to raw {{(pid=88095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 30 16:42:52 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:43:01 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (77c9dbb0-ae9f-4ca7-b93f-71b65bfa8d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8108f36-4f81-4922-9436-fbb78c05384d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8108f36-4f81-4922-9436-fbb78c05384d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-667102332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e682aff-8a68-4e8f-8b98-d55720dcfd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:11Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998184ed-d13b-4a80-ab3f-daad3aa08b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998184ed-d13b-4a80-ab3f-daad3aa08b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0987713-92a2-42c6-80c7-47a49f1af967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0987713-92a2-42c6-80c7-47a49f1af967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e682aff-8a68-4e8f-8b98-d55720dcfd62', 'volume_name': 'volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d470855-6073-4b4d-bb45-fd7425a90921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d470855-6073-4b4d-bb45-fd7425a90921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52135057-f825-486f-8428-c7c2019685e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:11 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Volume 2e682aff-8a68-4e8f-8b98-d55720dcfd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62', 'volume_size': 1} Jul 30 16:43:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.595s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Uploaded volume to glance image-id: 1326c3df-aa56-4aac-875c-fb8b3994a88d. {{(pid=88095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-667102332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e682aff-8a68-4e8f-8b98-d55720dcfd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:11Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Creating volume 2e682aff-8a68-4e8f-8b98-d55720dcfd62 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:12 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:12 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 1073741824 Jul 30 16:43:12 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:12 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0755553a-99f9-4c77-89a9-c95ca4fc9ccb tempest-TestImageHashVerification-1241600928 None] Copy volume to image completed successfully. Jul 30 16:43:13 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 1073741824" returned: 0 in 0.420s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:13 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 Jul 30 16:43:13 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:13 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62" returned: 0 in 0.263s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52135057-f825-486f-8428-c7c2019685e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e510085-5cd6-4a8a-bd21-ae810a21a1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:13 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Volume volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 (2e682aff-8a68-4e8f-8b98-d55720dcfd62): created successfully Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e510085-5cd6-4a8a-bd21-ae810a21a1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (77c9dbb0-ae9f-4ca7-b93f-71b65bfa8d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-534e4bf4-c9fb-4d34-8dcb-6a5d9a6a0e9a tempest-VolumesActionsTest-1490221654 None] Created volume successfully. Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Acquiring lock "cinder-8d693be0-a77c-4f0a-aa8d-71177ae5d012-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Lock "cinder-8d693be0-a77c-4f0a-aa8d-71177ae5d012-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Acquiring lock "cinder-quobyte-8d693be0-a77c-4f0a-aa8d-71177ae5d012" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Lock "cinder-quobyte-8d693be0-a77c-4f0a-aa8d-71177ae5d012" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3b709b-b366-463a-81b1-8d8f178a08b2]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:13 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 Jul 30 16:43:13 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:14 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012" returned: 0 in 0.345s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:14 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012 Jul 30 16:43:14 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:14 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-8d693be0-a77c-4f0a-aa8d-71177ae5d012" returned: 0 in 0.249s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Lock "cinder-quobyte-8d693be0-a77c-4f0a-aa8d-71177ae5d012" released by "delete_volume" :: held 0.642s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4baf5a7a-c0fa-4002-9c2f-1cb3e1bc0eda tempest-VolumesActionsTest-1490221654 None] Acquiring lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62" by "attach_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4baf5a7a-c0fa-4002-9c2f-1cb3e1bc0eda tempest-VolumesActionsTest-1490221654 None] Lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62" acquired by "attach_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Created reservations ['1570e907-626a-47bb-b0b5-d8c018f9ae18', '2bfb12c5-2eba-41eb-b322-1a4047ba0815', '9e738b03-1f27-4b70-a48c-ef6eee9bad19', '39ebe954-3fb9-4c30-88f0-7ce8ca7e8d0b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4baf5a7a-c0fa-4002-9c2f-1cb3e1bc0eda tempest-VolumesActionsTest-1490221654 None] Attaching volume 2e682aff-8a68-4e8f-8b98-d55720dcfd62 to instance 7054a144-aa78-4e9f-8056-2d7f98aceec1 at mountpoint /dev/vdb on host None. Jul 30 16:43:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4baf5a7a-c0fa-4002-9c2f-1cb3e1bc0eda tempest-VolumesActionsTest-1490221654 None] Attach volume completed successfully. Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4baf5a7a-c0fa-4002-9c2f-1cb3e1bc0eda tempest-VolumesActionsTest-1490221654 None] Lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62" released by "attach_volume" :: held 0.117s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:14 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:14 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:14 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.300s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:14 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Deleted volume successfully. Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e17e098d-125a-44d9-b716-5b610d3233cd tempest-TestImageHashVerification-1241600928 None] Lock "cinder-8d693be0-a77c-4f0a-aa8d-71177ae5d012-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-60ea9626-b44b-42a3-a0fe-2fb6fcaf9603 tempest-VolumesActionsTest-66572181 None] Terminate volume connection completed successfully. Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-60ea9626-b44b-42a3-a0fe-2fb6fcaf9603 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-detach_volume" by "detach_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-60ea9626-b44b-42a3-a0fe-2fb6fcaf9603 tempest-VolumesActionsTest-66572181 None] Lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-60ea9626-b44b-42a3-a0fe-2fb6fcaf9603 tempest-VolumesActionsTest-66572181 None] Detaching volume 2e682aff-8a68-4e8f-8b98-d55720dcfd62 from instance 7054a144-aa78-4e9f-8056-2d7f98aceec1. Jul 30 16:43:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-60ea9626-b44b-42a3-a0fe-2fb6fcaf9603 tempest-VolumesActionsTest-66572181 None] Detach volume completed successfully. Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-60ea9626-b44b-42a3-a0fe-2fb6fcaf9603 tempest-VolumesActionsTest-66572181 None] Lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7a4062f5-26ce-4ef7-85cc-e237cc361365 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-detach_volume" by "detach_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7a4062f5-26ce-4ef7-85cc-e237cc361365 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7a4062f5-26ce-4ef7-85cc-e237cc361365 tempest-VolumesActionsTest-1490221654 None] Volume detach called, but volume not attached. Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7a4062f5-26ce-4ef7-85cc-e237cc361365 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "cinder-quobyte-2e682aff-8a68-4e8f-8b98-d55720dcfd62" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-quobyte-2e682aff-8a68-4e8f-8b98-d55720dcfd62" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2983fe4-4fba-4d20-a910-699f53b9168a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:16 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 Jul 30 16:43:16 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:16 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62" returned: 0 in 0.407s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:16 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62 Jul 30 16:43:16 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:16 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2e682aff-8a68-4e8f-8b98-d55720dcfd62" returned: 0 in 0.381s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-quobyte-2e682aff-8a68-4e8f-8b98-d55720dcfd62" released by "delete_volume" :: held 0.842s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:16 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Created reservations ['281322e1-1bf0-4afc-91b8-d7a89570efc1', '37fea8d6-84e0-4b54-a88b-72aa81c97ee2', '00a7881a-efe4-45c4-90ca-45e00f698bd0', '1c695be5-b980-4fcc-a68f-c726262a9bf0'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:17 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:17 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:17 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.320s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Deleted volume successfully. Jul 30 16:43:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3874afdb-c9ce-4d68-a5ec-813a85acba92 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-2e682aff-8a68-4e8f-8b98-d55720dcfd62-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (f5d9bc62-bf1d-409f-8ea5-280cf1f305db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7edc8b-923b-4e73-a45f-dfb4b1df35ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7edc8b-923b-4e73-a45f-dfb4b1df35ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-66728586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:21Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c60797a-5958-43d0-9a32-b3d7356817bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c60797a-5958-43d0-9a32-b3d7356817bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072b9449-a371-4d3c-bf1f-e2ed05bbc02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072b9449-a371-4d3c-bf1f-e2ed05bbc02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793', 'volume_name': 'volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5490a4b0-78ed-4f82-a6dc-a93ca4d6621e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5490a4b0-78ed-4f82-a6dc-a93ca4d6621e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7b9db4-12d3-4e40-bc55-fc361f2a3c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:21 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Volume ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793', 'volume_size': 1} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-66728586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:21Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Creating volume ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:21 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:21 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 1073741824 Jul 30 16:43:21 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:21 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 1073741824" returned: 0 in 0.489s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:21 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 Jul 30 16:43:21 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:22 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793" returned: 0 in 0.296s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7b9db4-12d3-4e40-bc55-fc361f2a3c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d034e80-8a81-44aa-842a-c0da76d3e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:22 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Volume volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 (ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793): created successfully Jul 30 16:43:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d034e80-8a81-44aa-842a-c0da76d3e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (f5d9bc62-bf1d-409f-8ea5-280cf1f305db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:22 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0fcd9bfc-44af-48fd-81a4-07ae810c9056 tempest-VolumesActionsTest-1490221654 None] Created volume successfully. Jul 30 16:43:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Lock "cinder-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-quobyte-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:23 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Lock "cinder-quobyte-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:23 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d25f0-4cc9-4052-a27e-5d0b9e523d20]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:23 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 Jul 30 16:43:23 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:23 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793" returned: 0 in 0.482s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:24 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793 Jul 30 16:43:24 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:24 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793" returned: 0 in 0.291s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Lock "cinder-quobyte-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793" released by "delete_volume" :: held 0.820s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Created reservations ['047ae4d7-0bf1-496c-bc7f-b18cfead54f2', '958553df-565e-4aa2-b1c8-04a725e6864e', '3e15bfde-3ca3-46fc-a093-a24f1104e7c1', '233de262-8873-4761-8aa2-9c63c6d4167b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:24 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:24 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:24 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.271s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:24 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Deleted volume successfully. Jul 30 16:43:24 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5bc797f1-9e26-48aa-8d2b-71e9538681d1 tempest-VolumesActionsTest-66572181 None] Lock "cinder-ccb9c4f5-d0a5-4b24-a3d9-a81b9427b793-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (76ac8aea-2985-4e33-ace8-1a16fa3d66d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5146f5ba-0c6d-45d0-ad90-e52315273fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5146f5ba-0c6d-45d0-ad90-e52315273fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424860561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda9225b-ba9d-4926-bbd7-db2be9a23cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:25Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32762b93-536e-481f-a9f7-a68abb2cb1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32762b93-536e-481f-a9f7-a68abb2cb1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a6d265-ff36-4697-9e04-25b0fef9c06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a6d265-ff36-4697-9e04-25b0fef9c06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda9225b-ba9d-4926-bbd7-db2be9a23cb2', 'volume_name': 'volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6e492f-83a7-4c20-bb87-f643b6b65f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6e492f-83a7-4c20-bb87-f643b6b65f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de1f78-3209-4692-9a91-72007bf8e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:25 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Volume eda9225b-ba9d-4926-bbd7-db2be9a23cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2', 'volume_size': 1} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424860561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda9225b-ba9d-4926-bbd7-db2be9a23cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:25Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Creating volume eda9225b-ba9d-4926-bbd7-db2be9a23cb2 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:25 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:25 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 1073741824 Jul 30 16:43:25 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:25 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 1073741824" returned: 0 in 0.455s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:25 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 Jul 30 16:43:25 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:25 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2" returned: 0 in 0.247s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de1f78-3209-4692-9a91-72007bf8e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b6697e-939c-4912-891d-f70fc3a124da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:26 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Volume volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 (eda9225b-ba9d-4926-bbd7-db2be9a23cb2): created successfully Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b6697e-939c-4912-891d-f70fc3a124da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (76ac8aea-2985-4e33-ace8-1a16fa3d66d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:26 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-277c5ed9-8894-414d-a691-a06f6ab92538 tempest-VolumesActionsTest-1490221654 None] Created volume successfully. Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-eda9225b-ba9d-4926-bbd7-db2be9a23cb2-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Lock "cinder-eda9225b-ba9d-4926-bbd7-db2be9a23cb2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-quobyte-eda9225b-ba9d-4926-bbd7-db2be9a23cb2" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Lock "cinder-quobyte-eda9225b-ba9d-4926-bbd7-db2be9a23cb2" acquired by "delete_volume" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd79be9-1a9b-4b71-a2e4-75295aa67e21]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:26 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 Jul 30 16:43:26 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:26 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2" returned: 0 in 0.408s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:26 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2 Jul 30 16:43:26 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:27 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-eda9225b-ba9d-4926-bbd7-db2be9a23cb2" returned: 0 in 0.262s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Lock "cinder-quobyte-eda9225b-ba9d-4926-bbd7-db2be9a23cb2" released by "delete_volume" :: held 0.722s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Created reservations ['3e6b2567-b96a-4eb1-9f90-b7529d80ebc1', '20a3725c-45d4-448f-a4ac-c2ddfed73010', '6450e40b-b760-4390-b4b7-0d7ae976bef6', 'de56bec5-cbf7-4a21-a815-56b745a1ede4'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:27 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:27 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:27 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.257s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Deleted volume successfully. Jul 30 16:43:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ec0cd00d-6ae5-445b-8115-203ad3f3e0f7 tempest-VolumesActionsTest-66572181 None] Lock "cinder-eda9225b-ba9d-4926-bbd7-db2be9a23cb2-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (6ba9cc39-86bd-46ea-a0bc-ea78c335f927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687c7a6c-50ea-4ab7-bfe1-5101bab0f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687c7a6c-50ea-4ab7-bfe1-5101bab0f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-653037199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2bb21c-fee5-4e99-a392-b2ea0bebbe73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:28Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a0d4e2-0be5-47c0-b58b-c88938731123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a0d4e2-0be5-47c0-b58b-c88938731123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1694dbb-1252-4925-96c9-31f66af44c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1694dbb-1252-4925-96c9-31f66af44c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2bb21c-fee5-4e99-a392-b2ea0bebbe73', 'volume_name': 'volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab7002f-241c-4c75-b31c-02263c3567b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab7002f-241c-4c75-b31c-02263c3567b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1806ca2b-0137-47ea-b3fc-519d00556306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Volume 0b2bb21c-fee5-4e99-a392-b2ea0bebbe73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73', 'volume_size': 1} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-653037199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2bb21c-fee5-4e99-a392-b2ea0bebbe73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:28Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Creating volume 0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:28 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:28 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 1073741824 Jul 30 16:43:28 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:28 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 1073741824" returned: 0 in 0.441s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:28 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 Jul 30 16:43:28 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:28 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73" returned: 0 in 0.272s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1806ca2b-0137-47ea-b3fc-519d00556306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f42b0d-79b8-406f-b33f-d8bfebcfc2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Volume volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 (0b2bb21c-fee5-4e99-a392-b2ea0bebbe73): created successfully Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f42b0d-79b8-406f-b33f-d8bfebcfc2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (6ba9cc39-86bd-46ea-a0bc-ea78c335f927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:28 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f84cf0f7-f281-4011-9064-3e920d695d6b tempest-VolumesActionsTest-1490221654 None] Created volume successfully. Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Lock "cinder-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-quobyte-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Lock "cinder-quobyte-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6fc45a-b0aa-480a-b1aa-efa0f9f3713f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:29 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 Jul 30 16:43:29 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:29 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73" returned: 0 in 0.382s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:29 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73 Jul 30 16:43:29 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:29 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73" returned: 0 in 0.264s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Lock "cinder-quobyte-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73" released by "delete_volume" :: held 0.691s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:29 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Created reservations ['e2854bf9-9031-4761-89df-5e398a1f3551', '5f466871-54cf-4830-bac0-04c0328abb21', '52b674c0-5aed-43f6-b5f5-061436211e68', '4f05b299-8269-473f-9007-a221fd8497a8'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:30 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:30 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:30 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.250s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Deleted volume successfully. Jul 30 16:43:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-efa13d13-5b84-4b33-9dc2-c3b9a6aa80e5 tempest-VolumesActionsTest-66572181 None] Lock "cinder-0b2bb21c-fee5-4e99-a392-b2ea0bebbe73-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (361f8973-a47c-4aec-b0be-96ccb7344309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97579e09-44c6-4de3-8b6e-13e84c93db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97579e09-44c6-4de3-8b6e-13e84c93db8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-69512173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28a0934-72ab-42e9-a48c-98fda34d7e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:31Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0d3927-f2f9-4dfe-b556-4ce8fab1dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0d3927-f2f9-4dfe-b556-4ce8fab1dedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89c1193-285b-47ea-a72d-0b17e6b01b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89c1193-285b-47ea-a72d-0b17e6b01b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28a0934-72ab-42e9-a48c-98fda34d7e25', 'volume_name': 'volume-d28a0934-72ab-42e9-a48c-98fda34d7e25', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1e7d2b-8d3a-4b3f-9b54-ab4be5f0acdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1e7d2b-8d3a-4b3f-9b54-ab4be5f0acdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b8d288-e6d1-4090-aac9-78d222af9e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Volume d28a0934-72ab-42e9-a48c-98fda34d7e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28a0934-72ab-42e9-a48c-98fda34d7e25', 'volume_size': 1} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-69512173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28a0934-72ab-42e9-a48c-98fda34d7e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:31Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Creating volume d28a0934-72ab-42e9-a48c-98fda34d7e25 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:31 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:31 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 1073741824 Jul 30 16:43:31 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Flow 'volume_create_manager' (969e5bc9-9548-429b-9d9f-eb732608198f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b58ba5-720e-46f8-8701-a99370681ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b58ba5-720e-46f8-8701-a99370681ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f44ad9-501f-41c0-89ba-4e9d7614d18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a3d6859607455182152f45d47f2a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:31Z,use_quota=True,user_id='d4a2db4690c04d9d9c9a3502b82335e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062edbf3-c6e0-4ec4-bf11-6b5dcb8d1316),volume_type_id=062edbf3-c6e0-4ec4-bf11-6b5dcb8d1316)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a3f362-cebf-4abe-b30b-b6d078523e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a3f362-cebf-4abe-b30b-b6d078523e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b9e28e-a921-466c-a6d8-743dfbe0ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b9e28e-a921-466c-a6d8-743dfbe0ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08f44ad9-501f-41c0-89ba-4e9d7614d18c', 'volume_name': 'volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c', 'volume_size': 1, 'image_id': 'c41216a8-6022-4ede-9327-93c81766864d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c41216a8-6022-4ede-9327-93c81766864d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73bdeda422bee79406f77595e11a41b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3a3d6859607455182152f45d47f2a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00a169b0477aa7e5854f59bf67aeee196ae0bccdfdeda963f3c5331678341cbd3b11a52a77a92e8481400cbc478339ebfeefb439bf6514ad3fe7551f1c0d29fa', 'id': 'c41216a8-6022-4ede-9327-93c81766864d', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c41216a8-6022-4ede-9327-93c81766864d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b048af88-9869-435f-933d-6513eee3d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b048af88-9869-435f-933d-6513eee3d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb12caa9-3298-4d00-98d3-b712d2cd19d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Volume 08f44ad9-501f-41c0-89ba-4e9d7614d18c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c', 'volume_size': 1, 'image_id': 'c41216a8-6022-4ede-9327-93c81766864d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c41216a8-6022-4ede-9327-93c81766864d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73bdeda422bee79406f77595e11a41b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3a3d6859607455182152f45d47f2a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00a169b0477aa7e5854f59bf67aeee196ae0bccdfdeda963f3c5331678341cbd3b11a52a77a92e8481400cbc478339ebfeefb439bf6514ad3fe7551f1c0d29fa', 'id': 'c41216a8-6022-4ede-9327-93c81766864d', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c41216a8-6022-4ede-9327-93c81766864d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Trying to clone 08f44ad9-501f-41c0-89ba-4e9d7614d18c from image c41216a8-6022-4ede-9327-93c81766864d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c41216a8-6022-4ede-9327-93c81766864d', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:43:31 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:43:31 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 1073741824" returned: 0 in 0.467s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5606dc0-8a95-4b29-8d75-595e72eb7a14]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:31 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 Jul 30 16:43:31 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:31 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD Jul 30 16:43:31 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:31 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25" returned: 0 in 0.268s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b8d288-e6d1-4090-aac9-78d222af9e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28a0934-72ab-42e9-a48c-98fda34d7e25', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcca324-ee9f-469e-9a70-0c68b671c6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Volume volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 (d28a0934-72ab-42e9-a48c-98fda34d7e25): created successfully Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcca324-ee9f-469e-9a70-0c68b671c6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (361f8973-a47c-4aec-b0be-96ccb7344309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:32 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7876180a-df37-450c-a366-c73da4e48eeb tempest-VolumesActionsTest-1490221654 None] Created volume successfully. Jul 30 16:43:32 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD Jul 30 16:43:32 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:32 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Temporary image c41216a8-6022-4ede-9327-93c81766864d is fetched for user d4a2db4690c04d9d9c9a3502b82335e4. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78dec9e-d555-4bc8-9153-3c27a3e16a3d]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:32 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD Jul 30 16:43:32 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:32 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:32 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD Jul 30 16:43:32 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:33 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f44ad9-501f-41c0-89ba-4e9d7614d18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a3d6859607455182152f45d47f2a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:31Z,use_quota=True,user_id='d4a2db4690c04d9d9c9a3502b82335e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062edbf3-c6e0-4ec4-bf11-6b5dcb8d1316),volume_type_id=062edbf3-c6e0-4ec4-bf11-6b5dcb8d1316)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Creating volume 08f44ad9-501f-41c0-89ba-4e9d7614d18c {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:33 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:33 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c 1073741824 Jul 30 16:43:33 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-d28a0934-72ab-42e9-a48c-98fda34d7e25-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Lock "cinder-d28a0934-72ab-42e9-a48c-98fda34d7e25-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Acquiring lock "cinder-quobyte-d28a0934-72ab-42e9-a48c-98fda34d7e25" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Lock "cinder-quobyte-d28a0934-72ab-42e9-a48c-98fda34d7e25" acquired by "delete_volume" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4894940-752b-4985-89e9-ed9d9386a44a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:33 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 Jul 30 16:43:33 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:33 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c 1073741824" returned: 0 in 0.433s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:33 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c Jul 30 16:43:33 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:33 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:33 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25 Jul 30 16:43:33 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:33 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c" returned: 0 in 0.252s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Attempting download of c41216a8-6022-4ede-9327-93c81766864d ((None, [{'url': 'file:///opt/stack/data/glance/images/c41216a8-6022-4ede-9327-93c81766864d', 'metadata': {}}])) to volume 08f44ad9-501f-41c0-89ba-4e9d7614d18c. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[deebcd6b-e926-49ad-a68a-edb685b71338]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c41216a8-6022-4ede-9327-93c81766864d_w185isgf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:33 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d28a0934-72ab-42e9-a48c-98fda34d7e25" returned: 0 in 0.265s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Lock "cinder-quobyte-d28a0934-72ab-42e9-a48c-98fda34d7e25" released by "delete_volume" :: held 0.675s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:33 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c41216a8-6022-4ede-9327-93c81766864d_w185isgf Jul 30 16:43:33 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:33 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Created reservations ['ffb8b96f-f11f-4cf4-ba88-e430a60be96d', '7661c0bb-0d36-4937-95ae-f8885a1c2812', '3881fa0e-7306-4c40-9331-1bd4e33d893c', '463221e8-75f5-4a78-832d-42fa9a5d3bbd'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:34 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:34 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:34 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c41216a8-6022-4ede-9327-93c81766864d_w185isgf" returned: 0 in 0.333s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c41216a8-6022-4ede-9327-93c81766864d_w185isgf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:34 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c41216a8-6022-4ede-9327-93c81766864d_w185isgf Jul 30 16:43:34 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:34 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.257s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:34 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Deleted volume successfully. Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e760404f-a656-4805-875a-88df93767ac5 tempest-VolumesActionsTest-66572181 None] Lock "cinder-d28a0934-72ab-42e9-a48c-98fda34d7e25-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:34 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c41216a8-6022-4ede-9327-93c81766864d_w185isgf" returned: 1 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c41216a8-6022-4ede-9327-93c81766864d_w185isgf' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76549459-f594-4f15-b322-3bd595397807]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:34 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD Jul 30 16:43:34 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (835f773a-57d5-4c30-a279-e61f8f011395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:34 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e98b3b-f5d9-43bd-bb13-05aa86fee1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e98b3b-f5d9-43bd-bb13-05aa86fee1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-308851076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134c96fd-7994-48cf-9dae-f7490dc37584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:35Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff10757-fc09-48de-823b-13a3a6c9b2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff10757-fc09-48de-823b-13a3a6c9b2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b6daf0-3746-4b3e-8529-06ad6efa9f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b6daf0-3746-4b3e-8529-06ad6efa9f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134c96fd-7994-48cf-9dae-f7490dc37584', 'volume_name': 'volume-134c96fd-7994-48cf-9dae-f7490dc37584', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67648055-c17b-43b3-ae11-27ac7bae5611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67648055-c17b-43b3-ae11-27ac7bae5611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de97f9a-5669-490f-85f1-6653f73ec29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:34 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Volume 134c96fd-7994-48cf-9dae-f7490dc37584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134c96fd-7994-48cf-9dae-f7490dc37584', 'volume_size': 1} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-308851076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134c96fd-7994-48cf-9dae-f7490dc37584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5731832701449b48e0fa9dbc5519da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:35Z,use_quota=True,user_id='45022c8393274decafba1bad105e1ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Creating volume 134c96fd-7994-48cf-9dae-f7490dc37584 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:34 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:34 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 1073741824 Jul 30 16:43:34 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:35 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD Jul 30 16:43:35 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:35 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] c41216a8-6022-4ede-9327-93c81766864d was raw, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c Jul 30 16:43:35 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:35 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 1073741824" returned: 0 in 0.430s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 Jul 30 16:43:35 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:35 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584" returned: 0 in 0.304s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:35 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c" returned: 0 in 0.514s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c41216a8-6022-4ede-9327-93c81766864d_gli08zvzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:43:35 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de97f9a-5669-490f-85f1-6653f73ec29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134c96fd-7994-48cf-9dae-f7490dc37584', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:35 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c 1G Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46338146-cf4f-44fd-b5b3-e07878edbdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:35 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Volume volume-134c96fd-7994-48cf-9dae-f7490dc37584 (134c96fd-7994-48cf-9dae-f7490dc37584): created successfully Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46338146-cf4f-44fd-b5b3-e07878edbdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Flow 'volume_create_manager' (835f773a-57d5-4c30-a279-e61f8f011395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:35 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cc5b82de-4aba-4e14-b01c-2db006fe84fe tempest-VolumesActionsTest-1490221654 None] Created volume successfully. Jul 30 16:43:36 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c 1G" returned: 0 in 0.311s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Downloaded image c41216a8-6022-4ede-9327-93c81766864d ((None, [{'url': 'file:///opt/stack/data/glance/images/c41216a8-6022-4ede-9327-93c81766864d', 'metadata': {}}])) to volume 08f44ad9-501f-41c0-89ba-4e9d7614d18c successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Temporary image c41216a8-6022-4ede-9327-93c81766864d for user d4a2db4690c04d9d9c9a3502b82335e4 is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Marking volume 08f44ad9-501f-41c0-89ba-4e9d7614d18c as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Copying metadata from image c41216a8-6022-4ede-9327-93c81766864d to 08f44ad9-501f-41c0-89ba-4e9d7614d18c. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Creating volume glance metadata for volume 08f44ad9-501f-41c0-89ba-4e9d7614d18c backed by image c41216a8-6022-4ede-9327-93c81766864d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c41216a8-6022-4ede-9327-93c81766864d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '73bdeda422bee79406f77595e11a41b6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb12caa9-3298-4d00-98d3-b712d2cd19d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c', 'volume_size': 1, 'image_id': 'c41216a8-6022-4ede-9327-93c81766864d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c41216a8-6022-4ede-9327-93c81766864d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73bdeda422bee79406f77595e11a41b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3a3d6859607455182152f45d47f2a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00a169b0477aa7e5854f59bf67aeee196ae0bccdfdeda963f3c5331678341cbd3b11a52a77a92e8481400cbc478339ebfeefb439bf6514ad3fe7551f1c0d29fa', 'id': 'c41216a8-6022-4ede-9327-93c81766864d', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c41216a8-6022-4ede-9327-93c81766864d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca51563-fdab-4257-aae2-e686b39fdeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:36 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Volume volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c (08f44ad9-501f-41c0-89ba-4e9d7614d18c): created successfully Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca51563-fdab-4257-aae2-e686b39fdeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Flow 'volume_create_manager' (969e5bc9-9548-429b-9d9f-eb732608198f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-115b5de2-e8b9-47ca-a18c-30aad870b8d3 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Created volume successfully. Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Acquiring lock "cinder-08f44ad9-501f-41c0-89ba-4e9d7614d18c-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "cinder-08f44ad9-501f-41c0-89ba-4e9d7614d18c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Acquiring lock "cinder-quobyte-08f44ad9-501f-41c0-89ba-4e9d7614d18c" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "cinder-quobyte-08f44ad9-501f-41c0-89ba-4e9d7614d18c" acquired by "delete_volume" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ea16e9-d8b4-4843-90a0-0c528ea730f9]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "cinder-134c96fd-7994-48cf-9dae-f7490dc37584-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-134c96fd-7994-48cf-9dae-f7490dc37584-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:37 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c Jul 30 16:43:37 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "cinder-quobyte-134c96fd-7994-48cf-9dae-f7490dc37584" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-quobyte-134c96fd-7994-48cf-9dae-f7490dc37584" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0136e709-150a-4c92-ad9e-12185f72a55f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:37 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 Jul 30 16:43:37 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:37 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c" returned: 0 in 0.375s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:37 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c Jul 30 16:43:37 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:37 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584" returned: 0 in 0.383s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:38 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584 Jul 30 16:43:38 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:38 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-08f44ad9-501f-41c0-89ba-4e9d7614d18c" returned: 0 in 0.258s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "cinder-quobyte-08f44ad9-501f-41c0-89ba-4e9d7614d18c" released by "delete_volume" :: held 0.681s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:38 devstack cinder-volume[88095]: WARNING cinder.quota [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:43:38 devstack cinder-volume[88095]: WARNING cinder.quota [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Created reservations ['187077df-dc58-4282-972a-d2c7ff82ecb5', 'aa562f7a-7ff5-47ea-b203-062b2caa0c3e', 'b96fefdf-f51a-4273-90a7-5856e2d901a1', 'df56eaa5-f7ea-4d8e-bdcd-2f318dcfe141'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:38 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:38 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:38 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-134c96fd-7994-48cf-9dae-f7490dc37584" returned: 0 in 0.258s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-quobyte-134c96fd-7994-48cf-9dae-f7490dc37584" released by "delete_volume" :: held 0.687s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Created reservations ['307d87e0-f4f9-4810-a911-39050273628c', '84627221-7f2e-43f4-891f-8c2682c74182', '55ec7578-bb54-4042-82cf-3d67bb9dfe8a', '19e90eab-f42f-42d4-9761-1ef2eaee990d'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:38 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:38 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:38 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.262s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Deleted volume successfully. Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-065e69d7-055b-461d-9b97-54fc0c316303 tempest-VolumeAndVolumeTypeFromImageTest-846812082 None] Lock "cinder-08f44ad9-501f-41c0-89ba-4e9d7614d18c-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:38 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.292s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Deleted volume successfully. Jul 30 16:43:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-840e1f8a-2f70-44fb-9990-17a6898f0f20 tempest-VolumesActionsTest-1490221654 None] Lock "cinder-134c96fd-7994-48cf-9dae-f7490dc37584-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (655361ad-a0dc-447b-b7b8-22d9e962c7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26034ce-f40b-4111-a45b-79c3ec3be59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26034ce-f40b-4111-a45b-79c3ec3be59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965464855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928772c1-c459-42bb-a054-4db642f58677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:43Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d6a5f8-1103-4f35-8b80-53b05aa0e3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d6a5f8-1103-4f35-8b80-53b05aa0e3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80241565-d999-4b6a-ad92-e4bd5b58f686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80241565-d999-4b6a-ad92-e4bd5b58f686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928772c1-c459-42bb-a054-4db642f58677', 'volume_name': 'volume-928772c1-c459-42bb-a054-4db642f58677', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d57bd1-0e63-4d41-ba08-34706ff00fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d57bd1-0e63-4d41-ba08-34706ff00fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558dd5ce-e84e-4b22-9638-4c25050e8a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Volume 928772c1-c459-42bb-a054-4db642f58677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928772c1-c459-42bb-a054-4db642f58677', 'volume_size': 1} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965464855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928772c1-c459-42bb-a054-4db642f58677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:43Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Creating volume 928772c1-c459-42bb-a054-4db642f58677 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:43 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:43 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 1073741824 Jul 30 16:43:43 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (36d6f75c-46df-440a-8691-52cbbf6fc817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea9e8aa-5461-46e8-b8e9-8d99c4757375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea9e8aa-5461-46e8-b8e9-8d99c4757375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18950368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087b02e4-810a-4490-a8d8-f3bfae9fabde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:43Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebee6fc2-a98d-4f9a-b9ff-d6795201a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebee6fc2-a98d-4f9a-b9ff-d6795201a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8f86bf-7ed3-4b55-887c-5e4cf8a18d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8f86bf-7ed3-4b55-887c-5e4cf8a18d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087b02e4-810a-4490-a8d8-f3bfae9fabde', 'volume_name': 'volume-087b02e4-810a-4490-a8d8-f3bfae9fabde', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b842fdc3-b030-47ab-b441-f722cd775004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b842fdc3-b030-47ab-b441-f722cd775004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d388519-09e6-4b5a-89a5-a613450aff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:43 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Volume 087b02e4-810a-4490-a8d8-f3bfae9fabde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087b02e4-810a-4490-a8d8-f3bfae9fabde', 'volume_size': 1} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:43 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 1073741824" returned: 0 in 0.529s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:43 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 Jul 30 16:43:43 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:43 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (9be87933-41ea-4604-b445-5f5fba9c9ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945fc49f-dacd-488e-81e3-bf3bfb203e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945fc49f-dacd-488e-81e3-bf3bfb203e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2053705063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ea37fb-9963-4c4f-909c-c746317d9154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:44Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f04b03-4a6f-4581-ba03-1a1ed1095a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f04b03-4a6f-4581-ba03-1a1ed1095a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445a9c2d-865c-485c-aa10-0f6673dfabe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445a9c2d-865c-485c-aa10-0f6673dfabe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ea37fb-9963-4c4f-909c-c746317d9154', 'volume_name': 'volume-f3ea37fb-9963-4c4f-909c-c746317d9154', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799f4547-985a-4e80-ba08-935f5b9028ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799f4547-985a-4e80-ba08-935f5b9028ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a13e64-78c6-4faf-ac18-0660653ea809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Volume f3ea37fb-9963-4c4f-909c-c746317d9154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ea37fb-9963-4c4f-909c-c746317d9154', 'volume_size': 1} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:44 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677" returned: 0 in 0.374s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18950368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087b02e4-810a-4490-a8d8-f3bfae9fabde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:43Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Creating volume 087b02e4-810a-4490-a8d8-f3bfae9fabde {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:44 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:44 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde 1073741824 Jul 30 16:43:44 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558dd5ce-e84e-4b22-9638-4c25050e8a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928772c1-c459-42bb-a054-4db642f58677', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63af86e1-d6f8-49c7-a929-227e2abaa99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Volume volume-928772c1-c459-42bb-a054-4db642f58677 (928772c1-c459-42bb-a054-4db642f58677): created successfully Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63af86e1-d6f8-49c7-a929-227e2abaa99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (655361ad-a0dc-447b-b7b8-22d9e962c7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:44 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-23148000-399f-47df-b2c1-c5b98717ee4c tempest-CreateVolumesFromImageTest-32642921 None] Created volume successfully. Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (51986eda-48d8-46a7-9c0f-43b3ad7e7fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb31878f-19f1-436d-9cf9-a12d8bc51a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb31878f-19f1-436d-9cf9-a12d8bc51a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990960467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552bd9b8-c386-4d74-b6f1-2a156651a6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:44Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146b735e-489d-464d-9867-4db44c3ef5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146b735e-489d-464d-9867-4db44c3ef5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df10528c-a9fb-4926-9d39-b63b5c4b2f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df10528c-a9fb-4926-9d39-b63b5c4b2f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '552bd9b8-c386-4d74-b6f1-2a156651a6c5', 'volume_name': 'volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d14aa0b-11d4-434f-85be-b771ecee2218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d14aa0b-11d4-434f-85be-b771ecee2218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba5262f-3411-4f90-a6d9-778401dc604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Volume 552bd9b8-c386-4d74-b6f1-2a156651a6c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5', 'volume_size': 1} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:44 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde 1073741824" returned: 0 in 0.544s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:44 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde Jul 30 16:43:44 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (43f84236-ae5a-4309-bd1c-c7fa22fd5cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e526db-e666-490b-b8a2-4744eaf14478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e526db-e666-490b-b8a2-4744eaf14478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-97694080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ad8048-3a6e-42a8-8db7-b45d889ca4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:45Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9e2888-c913-4293-ac90-3dd2d873639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9e2888-c913-4293-ac90-3dd2d873639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a6a49e-755e-4386-9ce8-6d3fa85be725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a6a49e-755e-4386-9ce8-6d3fa85be725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ad8048-3a6e-42a8-8db7-b45d889ca4bf', 'volume_name': 'volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50a64bf-2e1e-4752-8f48-8730bda1eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50a64bf-2e1e-4752-8f48-8730bda1eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a0787e-9492-44ce-bfb2-b7367c152883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:44 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Volume 41ad8048-3a6e-42a8-8db7-b45d889ca4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf', 'volume_size': 1} Jul 30 16:43:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:45 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde" returned: 0 in 0.297s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2053705063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ea37fb-9963-4c4f-909c-c746317d9154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:44Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Creating volume f3ea37fb-9963-4c4f-909c-c746317d9154 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:45 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d388519-09e6-4b5a-89a5-a613450aff85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087b02e4-810a-4490-a8d8-f3bfae9fabde', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:45 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 1073741824 Jul 30 16:43:45 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06aa410e-9510-430b-aaa9-7829fa34ad10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:45 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Volume volume-087b02e4-810a-4490-a8d8-f3bfae9fabde (087b02e4-810a-4490-a8d8-f3bfae9fabde): created successfully Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06aa410e-9510-430b-aaa9-7829fa34ad10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (36d6f75c-46df-440a-8691-52cbbf6fc817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-52138ceb-77f7-4055-8335-3d65f7198e11 tempest-CreateVolumesFromImageTest-32642921 None] Created volume successfully. Jul 30 16:43:45 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 1073741824" returned: 0 in 0.484s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:45 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 Jul 30 16:43:45 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:45 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154" returned: 0 in 0.247s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990960467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552bd9b8-c386-4d74-b6f1-2a156651a6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:44Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Creating volume 552bd9b8-c386-4d74-b6f1-2a156651a6c5 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:45 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a13e64-78c6-4faf-ac18-0660653ea809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ea37fb-9963-4c4f-909c-c746317d9154', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97a1080-ce74-4001-a41e-710f743f6911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:45 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 1073741824 Jul 30 16:43:45 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:45 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Volume volume-f3ea37fb-9963-4c4f-909c-c746317d9154 (f3ea37fb-9963-4c4f-909c-c746317d9154): created successfully Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97a1080-ce74-4001-a41e-710f743f6911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (9be87933-41ea-4604-b445-5f5fba9c9ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6276d248-1a78-41c8-a655-dbb37cb86a6f tempest-CreateVolumesFromImageTest-32642921 None] Created volume successfully. Jul 30 16:43:46 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 1073741824" returned: 0 in 0.483s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:46 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 Jul 30 16:43:46 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:46 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5" returned: 0 in 0.284s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-97694080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ad8048-3a6e-42a8-8db7-b45d889ca4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f86587062e468ba081f12ca8211137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:45Z,use_quota=True,user_id='a8356b5fee9245d2aa1f5800212b868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Creating volume 41ad8048-3a6e-42a8-8db7-b45d889ca4bf {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:46 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba5262f-3411-4f90-a6d9-778401dc604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:46 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf 1073741824 Jul 30 16:43:46 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b801ca62-067c-4bc9-994b-91564afd1799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:46 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Volume volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 (552bd9b8-c386-4d74-b6f1-2a156651a6c5): created successfully Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b801ca62-067c-4bc9-994b-91564afd1799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (51986eda-48d8-46a7-9c0f-43b3ad7e7fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e9d6fbab-7f4d-47d2-aa8a-291c811f4917 tempest-CreateVolumesFromImageTest-32642921 None] Created volume successfully. Jul 30 16:43:47 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf 1073741824" returned: 0 in 0.485s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:47 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf Jul 30 16:43:47 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:47 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:47 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:47 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf" returned: 0 in 0.271s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a0787e-9492-44ce-bfb2-b7367c152883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af6b961-da0d-4236-af15-a5b01dab3106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:47 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Volume volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf (41ad8048-3a6e-42a8-8db7-b45d889ca4bf): created successfully Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af6b961-da0d-4236-af15-a5b01dab3106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Flow 'volume_create_manager' (43f84236-ae5a-4309-bd1c-c7fa22fd5cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c005eac1-de44-48ff-b00c-4d1bfc6cc21c tempest-CreateVolumesFromImageTest-32642921 None] Created volume successfully. Jul 30 16:43:47 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.302s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:43:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:43:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-41ad8048-3a6e-42a8-8db7-b45d889ca4bf-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-41ad8048-3a6e-42a8-8db7-b45d889ca4bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-quobyte-41ad8048-3a6e-42a8-8db7-b45d889ca4bf" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-41ad8048-3a6e-42a8-8db7-b45d889ca4bf" acquired by "delete_volume" :: waited 0.013s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:48 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ff6e1-2cba-4ddd-aee4-7077a0e27eb6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:48 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf Jul 30 16:43:48 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:48 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf" returned: 0 in 0.398s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:48 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf Jul 30 16:43:48 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:49 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-41ad8048-3a6e-42a8-8db7-b45d889ca4bf" returned: 0 in 0.243s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-41ad8048-3a6e-42a8-8db7-b45d889ca4bf" released by "delete_volume" :: held 0.680s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Created reservations ['c86e7180-fa94-4580-81c1-ccd33ab91670', '4a96de88-dd51-49ac-8fad-bf1453c3e28f', 'dcfd1fc6-61c4-4be3-9713-64836045e013', '3735e797-2d6f-44cd-9347-2a5d482edba4'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:49 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:49 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:49 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Deleted volume successfully. Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fc2e82da-5842-4d3a-b928-8eb7069f71dc tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-41ad8048-3a6e-42a8-8db7-b45d889ca4bf-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-552bd9b8-c386-4d74-b6f1-2a156651a6c5-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-552bd9b8-c386-4d74-b6f1-2a156651a6c5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-quobyte-552bd9b8-c386-4d74-b6f1-2a156651a6c5" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-552bd9b8-c386-4d74-b6f1-2a156651a6c5" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[761962bf-4e51-4aad-b600-81097e5e4ad2]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:49 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 Jul 30 16:43:49 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:49 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5" returned: 0 in 0.381s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:49 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5 Jul 30 16:43:49 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:50 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-552bd9b8-c386-4d74-b6f1-2a156651a6c5" returned: 0 in 0.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-552bd9b8-c386-4d74-b6f1-2a156651a6c5" released by "delete_volume" :: held 0.680s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Created reservations ['538c8d31-c654-4c7b-aa4e-343acff455d4', 'b161677b-ff3e-4596-9ab9-c4956aa38d31', 'ec1abded-e0d5-4197-a24a-fca7f9f48e5f', '5666eba6-dfdb-4dde-a065-546448f2ff2a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Flow 'volume_create_manager' (e5862f24-3af5-457a-a13e-d9eee70a1d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0e398d-3014-42f3-8807-cd5dcf77cb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0e398d-3014-42f3-8807-cd5dcf77cb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1235930046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6062f8d-feb2-4842-a521-115329a1c93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9897c61ae941499aa678581bdaf20277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:50Z,use_quota=True,user_id='f51697db37024e7d89035557ddadf2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44600a6-5d97-49dc-9a43-249b78c7a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44600a6-5d97-49dc-9a43-249b78c7a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8ed563-e118-4c27-934e-6d4cc9de73a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8ed563-e118-4c27-934e-6d4cc9de73a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6062f8d-feb2-4842-a521-115329a1c93b', 'volume_name': 'volume-e6062f8d-feb2-4842-a521-115329a1c93b', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5322b046-fed7-4e37-b292-116f5a6e635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5322b046-fed7-4e37-b292-116f5a6e635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb608941-0dc8-456f-bf0b-ff13c44832e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:50 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Volume e6062f8d-feb2-4842-a521-115329a1c93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6062f8d-feb2-4842-a521-115329a1c93b', 'volume_size': 1} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1235930046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6062f8d-feb2-4842-a521-115329a1c93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9897c61ae941499aa678581bdaf20277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:50Z,use_quota=True,user_id='f51697db37024e7d89035557ddadf2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Creating volume e6062f8d-feb2-4842-a521-115329a1c93b {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:50 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:50 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b 1073741824 Jul 30 16:43:50 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:50 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:50 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-f3ea37fb-9963-4c4f-909c-c746317d9154-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-f3ea37fb-9963-4c4f-909c-c746317d9154-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-quobyte-f3ea37fb-9963-4c4f-909c-c746317d9154" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-f3ea37fb-9963-4c4f-909c-c746317d9154" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:50 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.282s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Deleted volume successfully. Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c08d86-470e-47ee-82d1-d7701ffe9be0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-25206faf-ce26-4acb-8cae-e4568b58036c tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-552bd9b8-c386-4d74-b6f1-2a156651a6c5-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:50 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 Jul 30 16:43:50 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:50 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b 1073741824" returned: 0 in 0.480s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:50 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b Jul 30 16:43:50 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:51 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154" returned: 0 in 0.368s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:51 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154 Jul 30 16:43:51 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:51 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b" returned: 0 in 0.250s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb608941-0dc8-456f-bf0b-ff13c44832e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6062f8d-feb2-4842-a521-115329a1c93b', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1df0b3e-224e-4eae-b0d5-b2ffce108d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Volume volume-e6062f8d-feb2-4842-a521-115329a1c93b (e6062f8d-feb2-4842-a521-115329a1c93b): created successfully Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1df0b3e-224e-4eae-b0d5-b2ffce108d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Flow 'volume_create_manager' (e5862f24-3af5-457a-a13e-d9eee70a1d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-deb8d805-2f3c-430a-852f-6848b6f38dec tempest-VolumesListAdminTestJSON-516352579 None] Created volume successfully. Jul 30 16:43:51 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f3ea37fb-9963-4c4f-909c-c746317d9154" returned: 0 in 0.250s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-f3ea37fb-9963-4c4f-909c-c746317d9154" released by "delete_volume" :: held 0.661s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Created reservations ['2dea2f45-e029-412e-982c-c02619286f47', 'be1a68cd-cd4e-4309-acac-cf1fac3cc41f', '78bfca0b-b9e6-4b27-9227-b76edc2deb31', '73a613de-4097-43ea-acae-ec3fb2dad7da'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:51 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:51 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:51 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.236s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Deleted volume successfully. Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-238d0566-92d5-4c32-badc-1ec4d9b3adc7 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-f3ea37fb-9963-4c4f-909c-c746317d9154-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-087b02e4-810a-4490-a8d8-f3bfae9fabde-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-087b02e4-810a-4490-a8d8-f3bfae9fabde-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-quobyte-087b02e4-810a-4490-a8d8-f3bfae9fabde" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-087b02e4-810a-4490-a8d8-f3bfae9fabde" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[17685baa-4f89-4632-870a-a3e4544f5670]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:52 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde Jul 30 16:43:52 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:52 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde" returned: 0 in 0.342s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:52 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde Jul 30 16:43:52 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:52 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-087b02e4-810a-4490-a8d8-f3bfae9fabde" returned: 0 in 0.247s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-087b02e4-810a-4490-a8d8-f3bfae9fabde" released by "delete_volume" :: held 0.626s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Created reservations ['02b50037-24ff-47a1-a5a6-793c72ac679c', '514a78ba-d593-4781-88bc-3dc510a38a10', '719189ed-79f0-429a-be79-cf8f012e198c', 'a5161fd7-27de-4502-aee1-84d4daf5170f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:52 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:52 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:52 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.310s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Deleted volume successfully. Jul 30 16:43:52 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Flow 'volume_create_manager' (2109f633-4980-46d3-a52f-a07faeff2b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7868cf8-a4a3-4473-83ae-91885e165964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2335261-ff44-4ff2-b022-c043008bb1b0 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-087b02e4-810a-4490-a8d8-f3bfae9fabde-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-928772c1-c459-42bb-a054-4db642f58677-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7868cf8-a4a3-4473-83ae-91885e165964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-858229044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a97b57c-ba26-41f1-a8fc-505826577183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9897c61ae941499aa678581bdaf20277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:53Z,use_quota=True,user_id='f51697db37024e7d89035557ddadf2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0549f9-7c8f-4091-b69e-4df951d46a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0549f9-7c8f-4091-b69e-4df951d46a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7062928b-838b-4988-8348-26b2b1c73793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7062928b-838b-4988-8348-26b2b1c73793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a97b57c-ba26-41f1-a8fc-505826577183', 'volume_name': 'volume-3a97b57c-ba26-41f1-a8fc-505826577183', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2e8a37-22af-44b8-84c0-7bbcba968f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2e8a37-22af-44b8-84c0-7bbcba968f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3d2965-7618-4911-991a-f643339d553a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Volume 3a97b57c-ba26-41f1-a8fc-505826577183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a97b57c-ba26-41f1-a8fc-505826577183', 'volume_size': 1} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-858229044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a97b57c-ba26-41f1-a8fc-505826577183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9897c61ae941499aa678581bdaf20277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:53Z,use_quota=True,user_id='f51697db37024e7d89035557ddadf2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Creating volume 3a97b57c-ba26-41f1-a8fc-505826577183 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:53 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-928772c1-c459-42bb-a054-4db642f58677-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:53 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 1073741824 Jul 30 16:43:53 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "cinder-quobyte-928772c1-c459-42bb-a054-4db642f58677" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-928772c1-c459-42bb-a054-4db642f58677" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae868f4-bd0a-4687-9e76-0afe4df918da]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:53 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 Jul 30 16:43:53 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:53 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 1073741824" returned: 0 in 0.410s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:53 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677" returned: 0 in 0.363s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:53 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 Jul 30 16:43:53 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:53 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677 Jul 30 16:43:53 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:53 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:53 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183" returned: 0 in 0.272s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-928772c1-c459-42bb-a054-4db642f58677" returned: 0 in 0.261s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3d2965-7618-4911-991a-f643339d553a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a97b57c-ba26-41f1-a8fc-505826577183', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e820abd-762f-4103-b4de-a83f64c97fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-quobyte-928772c1-c459-42bb-a054-4db642f58677" released by "delete_volume" :: held 0.686s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Volume volume-3a97b57c-ba26-41f1-a8fc-505826577183 (3a97b57c-ba26-41f1-a8fc-505826577183): created successfully Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e820abd-762f-4103-b4de-a83f64c97fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Flow 'volume_create_manager' (2109f633-4980-46d3-a52f-a07faeff2b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:53 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f45ce72a-4ccf-4f28-b58d-cb32c279d417 tempest-VolumesListAdminTestJSON-516352579 None] Created volume successfully. Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Created reservations ['3c390366-ef9f-40f4-b9bc-eb743012b99c', 'c34803a7-cb3d-4a4b-8fd3-0da3e98ab299', 'fcc39041-aada-4beb-a66a-2ca1a63582fe', '770107de-8f4c-4fcb-9e90-15bcc5753a8c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:54 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:54 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:54 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.242s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:54 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Deleted volume successfully. Jul 30 16:43:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-285defa9-51fe-40b0-b974-c783099c6091 tempest-CreateVolumesFromImageTest-32642921 None] Lock "cinder-928772c1-c459-42bb-a054-4db642f58677-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Flow 'volume_create_manager' (a9350d1d-bef2-41db-80f1-4be847865d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976de485-ed94-4520-9af1-266c48c50cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976de485-ed94-4520-9af1-266c48c50cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2146086792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ab5404-2bdd-4179-a0b9-5577b409072d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9897c61ae941499aa678581bdaf20277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:55Z,use_quota=True,user_id='f51697db37024e7d89035557ddadf2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc410a8b-b54d-422e-8cfb-62be52c36e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc410a8b-b54d-422e-8cfb-62be52c36e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa1ac0e-c861-45b6-94c6-d1a0c0ea4254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa1ac0e-c861-45b6-94c6-d1a0c0ea4254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ab5404-2bdd-4179-a0b9-5577b409072d', 'volume_name': 'volume-d6ab5404-2bdd-4179-a0b9-5577b409072d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9334138e-4a0a-4a85-a073-3cb041a9fba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9334138e-4a0a-4a85-a073-3cb041a9fba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc061de-5607-4474-a58b-36b5aa12a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:55 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Volume d6ab5404-2bdd-4179-a0b9-5577b409072d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ab5404-2bdd-4179-a0b9-5577b409072d', 'volume_size': 1} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2146086792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6ab5404-2bdd-4179-a0b9-5577b409072d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9897c61ae941499aa678581bdaf20277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:55Z,use_quota=True,user_id='f51697db37024e7d89035557ddadf2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Creating volume d6ab5404-2bdd-4179-a0b9-5577b409072d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:55 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:55 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d 1073741824 Jul 30 16:43:55 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:56 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d 1073741824" returned: 0 in 0.424s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:56 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d Jul 30 16:43:56 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:56 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d" returned: 0 in 0.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc061de-5607-4474-a58b-36b5aa12a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ab5404-2bdd-4179-a0b9-5577b409072d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611f2277-0eb1-4ec9-a9a0-93f534329c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:56 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Volume volume-d6ab5404-2bdd-4179-a0b9-5577b409072d (d6ab5404-2bdd-4179-a0b9-5577b409072d): created successfully Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611f2277-0eb1-4ec9-a9a0-93f534329c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:56 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Flow 'volume_create_manager' (a9350d1d-bef2-41db-80f1-4be847865d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8b3a1528-c1c5-41a8-8318-5259b5bec97f tempest-VolumesListAdminTestJSON-516352579 None] Created volume successfully. Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Flow 'volume_create_manager' (b0ed7d6e-b011-4738-8e2c-3d1217074dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3011fe-5b93-4bfb-bfdc-bf36c0fb5eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3011fe-5b93-4bfb-bfdc-bf36c0fb5eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51bf1df-57c9-4ebb-a165-013f32cdc024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16bc14a3f714adbadacbebd79ca2202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:57Z,use_quota=True,user_id='ac97bfb6657f4a00a388041959e86673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9c544a-448b-4578-9525-4ddac5f9192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9c544a-448b-4578-9525-4ddac5f9192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de12e70-3c4d-49f5-809f-7930739dc68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de12e70-3c4d-49f5-809f-7930739dc68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51bf1df-57c9-4ebb-a165-013f32cdc024', 'volume_name': 'volume-e51bf1df-57c9-4ebb-a165-013f32cdc024', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19bb458-0674-4452-a9fc-8139e9087e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19bb458-0674-4452-a9fc-8139e9087e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd75d4a-229e-4643-9b92-4df0571aa988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:57 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Volume e51bf1df-57c9-4ebb-a165-013f32cdc024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51bf1df-57c9-4ebb-a165-013f32cdc024', 'volume_size': 1} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51bf1df-57c9-4ebb-a165-013f32cdc024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16bc14a3f714adbadacbebd79ca2202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:57Z,use_quota=True,user_id='ac97bfb6657f4a00a388041959e86673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Creating volume e51bf1df-57c9-4ebb-a165-013f32cdc024 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:57 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:57 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 1073741824 Jul 30 16:43:57 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:57 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 1073741824" returned: 0 in 0.440s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:57 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 Jul 30 16:43:57 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:58 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024" returned: 0 in 0.239s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd75d4a-229e-4643-9b92-4df0571aa988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51bf1df-57c9-4ebb-a165-013f32cdc024', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d474e428-5534-4ddb-87e2-835550ab4e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:58 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Volume volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 (e51bf1df-57c9-4ebb-a165-013f32cdc024): created successfully Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d474e428-5534-4ddb-87e2-835550ab4e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Flow 'volume_create_manager' (b0ed7d6e-b011-4738-8e2c-3d1217074dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8996a82a-0974-4160-8527-dde6f3c94448 tempest-VolumesListAdminTestJSON-601515283 None] Created volume successfully. Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Acquiring lock "cinder-e51bf1df-57c9-4ebb-a165-013f32cdc024-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Lock "cinder-e51bf1df-57c9-4ebb-a165-013f32cdc024-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Acquiring lock "cinder-quobyte-e51bf1df-57c9-4ebb-a165-013f32cdc024" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Lock "cinder-quobyte-e51bf1df-57c9-4ebb-a165-013f32cdc024" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4237081-2f24-4696-937e-a973bbc6df58]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "cinder-d6ab5404-2bdd-4179-a0b9-5577b409072d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-d6ab5404-2bdd-4179-a0b9-5577b409072d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "cinder-quobyte-d6ab5404-2bdd-4179-a0b9-5577b409072d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:58 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-quobyte-d6ab5404-2bdd-4179-a0b9-5577b409072d" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:58 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924f4d5-e8b4-4666-bdff-ade1fddbe01b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:58 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d Jul 30 16:43:58 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:58 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024" returned: 0 in 0.430s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:58 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024 Jul 30 16:43:58 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:59 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d" returned: 0 in 0.391s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:59 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d Jul 30 16:43:59 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:59 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Flow 'volume_create_manager' (e80eaa75-f4b1-40db-8745-6d753c5f9ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ca4a13-855b-4799-ae0c-4ddbc6b037fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e51bf1df-57c9-4ebb-a165-013f32cdc024" returned: 0 in 0.324s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ca4a13-855b-4799-ae0c-4ddbc6b037fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ee393a-8a2f-438e-9767-c827d5893496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b57870281d64238ae34c4b4932c184c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:59Z,use_quota=True,user_id='dbba75f1693d411fb267e0a1d2179144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c61a29b-42c3-4b16-b4f8-3c7a5815a282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c61a29b-42c3-4b16-b4f8-3c7a5815a282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bbd905-1146-495b-95b6-4c07a8adc3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Lock "cinder-quobyte-e51bf1df-57c9-4ebb-a165-013f32cdc024" released by "delete_volume" :: held 0.839s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:59 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d6ab5404-2bdd-4179-a0b9-5577b409072d" returned: 0 in 0.276s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-quobyte-d6ab5404-2bdd-4179-a0b9-5577b409072d" released by "delete_volume" :: held 0.712s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Created reservations ['15f4f9c3-ded5-4608-8b82-515f0fb422b3', '4684260f-b65d-447c-8945-7546a3e8d057', '4b3a9e97-3da5-4ee6-968e-a67cce58f2ee', '7f9efbd6-c878-46e4-b6ab-7e8cc83ff3e9'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Created reservations ['46e21b10-50ae-4eb7-b05d-86777e1de708', '10e00f38-8664-43e9-b123-34f13eb0893e', 'dd531c2b-3c7d-4dd9-adea-5b4040800e3b', 'f0d8acb4-1bd9-420d-b391-3dbab9f1b8b7'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:59 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:59 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:59 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:43:59 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bbd905-1146-495b-95b6-4c07a8adc3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73ee393a-8a2f-438e-9767-c827d5893496', 'volume_name': 'volume-73ee393a-8a2f-438e-9767-c827d5893496', 'volume_size': 1, 'image_id': '9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56ccfd983c81c12097ba8269dd9b07f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b57870281d64238ae34c4b4932c184c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f09aaea7cea68098257e6a4e7ce47fe45c40deb9a6ce1753e134e220f0973f53a64fec17b48e3f282d0e8878c9f9cfa353e72d89af857d80be931602af12c0f', 'id': '9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc/file', 'properties': {}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c637ce7-73d6-4e95-904c-371d6596087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c637ce7-73d6-4e95-904c-371d6596087d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be59a8fa-e16a-47fc-ad51-79f177924188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:59 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Volume 73ee393a-8a2f-438e-9767-c827d5893496: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73ee393a-8a2f-438e-9767-c827d5893496', 'volume_size': 1, 'image_id': '9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56ccfd983c81c12097ba8269dd9b07f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b57870281d64238ae34c4b4932c184c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f09aaea7cea68098257e6a4e7ce47fe45c40deb9a6ce1753e134e220f0973f53a64fec17b48e3f282d0e8878c9f9cfa353e72d89af857d80be931602af12c0f', 'id': '9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc/file', 'properties': {}}, 'image_service': } Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Trying to clone 73ee393a-8a2f-438e-9767-c827d5893496 from image 9d03dc12-9530-4ad1-ae6d-8efaa31e23cc at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:43:59 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.298s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Deleted volume successfully. Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2dd86269-d12d-4194-8fb5-4a4d4d140b88 tempest-VolumesListAdminTestJSON-601515283 None] Lock "cinder-e51bf1df-57c9-4ebb-a165-013f32cdc024-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:43:59 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:43:59 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.327s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Deleted volume successfully. Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "cinder-3a97b57c-ba26-41f1-a8fc-505826577183-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f7cc97bf-b50a-41e3-b77c-d8e89d518f19 tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-d6ab5404-2bdd-4179-a0b9-5577b409072d-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-3a97b57c-ba26-41f1-a8fc-505826577183-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed5a61-db04-49d5-8b0b-606d8e1e7398]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "cinder-quobyte-3a97b57c-ba26-41f1-a8fc-505826577183" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-quobyte-3a97b57c-ba26-41f1-a8fc-505826577183" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c16c788-0636-4e4d-9f04-34d1ea495b51]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:00 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD Jul 30 16:44:00 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:00 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 Jul 30 16:44:00 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:00 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:00 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183" returned: 0 in 0.351s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:00 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD Jul 30 16:44:00 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:00 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183 Jul 30 16:44:00 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:00 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Temporary image 9d03dc12-9530-4ad1-ae6d-8efaa31e23cc is fetched for user dbba75f1693d411fb267e0a1d2179144. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:44:00 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3a97b57c-ba26-41f1-a8fc-505826577183" returned: 0 in 0.253s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-quobyte-3a97b57c-ba26-41f1-a8fc-505826577183" released by "delete_volume" :: held 0.648s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ef69e1-f3fd-4d78-b60c-1e1d723e759a]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Created reservations ['a8d09db9-3e40-44d8-b323-5eae70cc13de', 'c80d0792-8aeb-41d0-8427-4ff82518a117', 'b69cd086-1bbb-4b34-8f56-71aa6157d82c', 'b60ee74d-8f10-4a5c-9fa8-6d9bb6c80e7a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:00 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD Jul 30 16:44:00 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:00 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:00 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:01 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.255s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:01 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Deleted volume successfully. Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-77d09103-fbbf-4830-b4a5-745568c185fd tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-3a97b57c-ba26-41f1-a8fc-505826577183-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "cinder-e6062f8d-feb2-4842-a521-115329a1c93b-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-e6062f8d-feb2-4842-a521-115329a1c93b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:01 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD Jul 30 16:44:01 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "cinder-quobyte-e6062f8d-feb2-4842-a521-115329a1c93b" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-quobyte-e6062f8d-feb2-4842-a521-115329a1c93b" acquired by "delete_volume" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55a6b6f-b302-4aaf-a64b-8a4b12aaf525]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:01 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b Jul 30 16:44:01 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:01 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ee393a-8a2f-438e-9767-c827d5893496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b57870281d64238ae34c4b4932c184c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:59Z,use_quota=True,user_id='dbba75f1693d411fb267e0a1d2179144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Creating volume 73ee393a-8a2f-438e-9767-c827d5893496 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:01 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:01 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 1073741824 Jul 30 16:44:01 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:01 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b" returned: 0 in 0.358s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:01 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b Jul 30 16:44:01 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:01 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 1073741824" returned: 0 in 0.419s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:01 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e6062f8d-feb2-4842-a521-115329a1c93b" returned: 0 in 0.277s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:01 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 Jul 30 16:44:01 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-quobyte-e6062f8d-feb2-4842-a521-115329a1c93b" released by "delete_volume" :: held 0.682s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:01 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Created reservations ['7943a067-5ae8-46a7-a482-a00a4f08d073', '002f885a-3c35-4605-b176-01e182f998ef', '34b09cbe-42d5-4353-a8d2-cefa366ffbbf', '261a6d3b-bd0a-4b39-bcee-8f12c8f59d57'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:02 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:02 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:02 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Attempting download of 9d03dc12-9530-4ad1-ae6d-8efaa31e23cc ((None, [{'url': 'file:///opt/stack/data/glance/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'metadata': {}}])) to volume 73ee393a-8a2f-438e-9767-c827d5893496. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f46e1ae-7c21-4773-ae96-a8775e2eca36]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc_iar98pan {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:02 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.248s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Deleted volume successfully. Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-35707ce5-b4c3-406c-8643-e6bfb03e2312 tempest-VolumesListAdminTestJSON-516352579 None] Lock "cinder-e6062f8d-feb2-4842-a521-115329a1c93b-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:02 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc_iar98pan Jul 30 16:44:02 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:02 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc_iar98pan" returned: 0 in 0.338s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc_iar98pan {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:02 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc_iar98pan Jul 30 16:44:02 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:02 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc_iar98pan" returned: 1 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc_iar98pan' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebbac77-310d-4340-b4da-e174f53d5195]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:03 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD Jul 30 16:44:03 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:03 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:03 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD Jul 30 16:44:03 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:03 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:44:03 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] 9d03dc12-9530-4ad1-ae6d-8efaa31e23cc was raw, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:44:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:03 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 Jul 30 16:44:03 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:04 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496" returned: 0 in 0.517s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d03dc12-9530-4ad1-ae6d-8efaa31e23cc__xwun0ptdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:44:04 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:04 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 1G Jul 30 16:44:04 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:04 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 1G" returned: 0 in 0.354s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Downloaded image 9d03dc12-9530-4ad1-ae6d-8efaa31e23cc ((None, [{'url': 'file:///opt/stack/data/glance/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'metadata': {}}])) to volume 73ee393a-8a2f-438e-9767-c827d5893496 successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Temporary image 9d03dc12-9530-4ad1-ae6d-8efaa31e23cc for user dbba75f1693d411fb267e0a1d2179144 is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Marking volume 73ee393a-8a2f-438e-9767-c827d5893496 as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Copying metadata from image 9d03dc12-9530-4ad1-ae6d-8efaa31e23cc to 73ee393a-8a2f-438e-9767-c827d5893496. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Creating volume glance metadata for volume 73ee393a-8a2f-438e-9767-c827d5893496 backed by image 9d03dc12-9530-4ad1-ae6d-8efaa31e23cc with: {'image_id': '9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '56ccfd983c81c12097ba8269dd9b07f7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=123,cinder:UPDATE=201,cinder:INSERT=45,cinder:DELETE=11 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be59a8fa-e16a-47fc-ad51-79f177924188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ee393a-8a2f-438e-9767-c827d5893496', 'volume_size': 1, 'image_id': '9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56ccfd983c81c12097ba8269dd9b07f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b57870281d64238ae34c4b4932c184c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f09aaea7cea68098257e6a4e7ce47fe45c40deb9a6ce1753e134e220f0973f53a64fec17b48e3f282d0e8878c9f9cfa353e72d89af857d80be931602af12c0f', 'id': '9d03dc12-9530-4ad1-ae6d-8efaa31e23cc', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d03dc12-9530-4ad1-ae6d-8efaa31e23cc/file', 'properties': {}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5029e79f-1e87-4198-a07f-5a5e76b2e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:04 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Volume volume-73ee393a-8a2f-438e-9767-c827d5893496 (73ee393a-8a2f-438e-9767-c827d5893496): created successfully Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5029e79f-1e87-4198-a07f-5a5e76b2e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Flow 'volume_create_manager' (e80eaa75-f4b1-40db-8745-6d753c5f9ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-41d16f59-c942-47c9-a1ee-4940977d6901 tempest-VolumeImageDependencyTests-308655673 None] Created volume successfully. Jul 30 16:44:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Acquiring lock "cinder-73ee393a-8a2f-438e-9767-c827d5893496-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Lock "cinder-73ee393a-8a2f-438e-9767-c827d5893496-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Acquiring lock "cinder-quobyte-73ee393a-8a2f-438e-9767-c827d5893496" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Lock "cinder-quobyte-73ee393a-8a2f-438e-9767-c827d5893496" acquired by "delete_volume" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e8dbc1-965a-421d-adad-a0a37ad69361]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:05 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 Jul 30 16:44:05 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:06 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496" returned: 0 in 0.358s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:06 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496 Jul 30 16:44:06 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:06 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-73ee393a-8a2f-438e-9767-c827d5893496" returned: 0 in 0.254s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Lock "cinder-quobyte-73ee393a-8a2f-438e-9767-c827d5893496" released by "delete_volume" :: held 0.655s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Created reservations ['ed2a58f9-81d0-455b-8ba0-718395b1f139', '87848cd3-dc99-4a51-a48f-e137da87c9b8', 'f7ab5363-49ba-43e5-adc3-8c488f498611', '90c921f4-2320-41cd-ad41-32b897f4f625'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:06 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:06 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Flow 'volume_create_manager' (2ec21216-e693-437e-b500-2febc630d7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315b5121-9f05-4df1-8ee8-bd90cda5717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315b5121-9f05-4df1-8ee8-bd90cda5717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-248893303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d65e5f-b4dc-4902-adff-9fd967f23ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f930c6eff2f49da82848c089128b7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:07Z,use_quota=True,user_id='912508474b964a31ad7ee09e4a08441a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3976b91-5f75-4626-9b64-dc5ece634ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3976b91-5f75-4626-9b64-dc5ece634ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c26e846-1eb9-4db3-af04-96f093b945f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:44:06 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.269s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:06 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Deleted volume successfully. Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9c461192-a6fb-47e0-800b-976478aa4fcc tempest-VolumeImageDependencyTests-308655673 None] Lock "cinder-73ee393a-8a2f-438e-9767-c827d5893496-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c26e846-1eb9-4db3-af04-96f093b945f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93d65e5f-b4dc-4902-adff-9fd967f23ce1', 'volume_name': 'volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b93c35-721a-45c1-986c-d5d84806f574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b93c35-721a-45c1-986c-d5d84806f574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd8e21a-ce55-41e0-a9ba-0ff18c4356eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:06 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Volume 93d65e5f-b4dc-4902-adff-9fd967f23ce1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:44:06 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Trying to clone 93d65e5f-b4dc-4902-adff-9fd967f23ce1 from image ea19a761-954a-4f28-b989-b2705e0735e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:44:07 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:44:07 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:44:07 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18da82-48cf-45c3-a95d-6829b318e47c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:07 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD Jul 30 16:44:07 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:07 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:07 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Temporary image ea19a761-954a-4f28-b989-b2705e0735e6 is fetched for user 912508474b964a31ad7ee09e4a08441a. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:44:07 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e359c29-6838-4e43-be6d-163117b15ff3]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:07 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD Jul 30 16:44:07 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:08 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-248893303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d65e5f-b4dc-4902-adff-9fd967f23ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f930c6eff2f49da82848c089128b7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:07Z,use_quota=True,user_id='912508474b964a31ad7ee09e4a08441a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Creating volume 93d65e5f-b4dc-4902-adff-9fd967f23ce1 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:08 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:08 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 1073741824 Jul 30 16:44:08 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:08 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 1073741824" returned: 0 in 0.526s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:08 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 Jul 30 16:44:08 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:08 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1" returned: 0 in 0.242s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Attempting download of ea19a761-954a-4f28-b989-b2705e0735e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}])) to volume 93d65e5f-b4dc-4902-adff-9fd967f23ce1. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaaeb34-635a-4200-88e1-75d55037ce4d]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_ym22brsp {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:09 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_ym22brsp Jul 30 16:44:09 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:09 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_ym22brsp" returned: 0 in 0.315s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_ym22brsp {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:09 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_ym22brsp Jul 30 16:44:09 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:09 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_ym22brsp" returned: 1 in 0.307s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea19a761-954a-4f28-b989-b2705e0735e6_ym22brsp' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb10338a-3b92-4444-a65d-416088dd23ca]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:09 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD Jul 30 16:44:09 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:09 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] ea19a761-954a-4f28-b989-b2705e0735e6 was qcow2, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:44:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:09 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 Jul 30 16:44:09 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:11 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1" returned: 0 in 1.564s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea19a761-954a-4f28-b989-b2705e0735e6_21f_ta0rdevstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:44:11 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Converted 112.00 MB image at 71.50 MB/s Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:11 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 1G Jul 30 16:44:11 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:11 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 1G" returned: 0 in 0.310s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Downloaded image ea19a761-954a-4f28-b989-b2705e0735e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}])) to volume 93d65e5f-b4dc-4902-adff-9fd967f23ce1 successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Temporary image ea19a761-954a-4f28-b989-b2705e0735e6 for user 912508474b964a31ad7ee09e4a08441a is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Marking volume 93d65e5f-b4dc-4902-adff-9fd967f23ce1 as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=165,cinder:UPDATE=196,cinder:INSERT=60,cinder:DELETE=23 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Copying metadata from image ea19a761-954a-4f28-b989-b2705e0735e6 to 93d65e5f-b4dc-4902-adff-9fd967f23ce1. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Creating volume glance metadata for volume 93d65e5f-b4dc-4902-adff-9fd967f23ce1 backed by image ea19a761-954a-4f28-b989-b2705e0735e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd8e21a-ce55-41e0-a9ba-0ff18c4356eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1', 'volume_size': 1, 'image_id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea19a761-954a-4f28-b989-b2705e0735e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bc4303bbd5f437fb1d6f62712db9b06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ea19a761-954a-4f28-b989-b2705e0735e6', 'created_at': datetime.datetime(2026, 7, 30, 14, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 22, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea19a761-954a-4f28-b989-b2705e0735e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81c4129-3aec-4e39-8fce-6988a28aa8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:11 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Volume volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 (93d65e5f-b4dc-4902-adff-9fd967f23ce1): created successfully Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81c4129-3aec-4e39-8fce-6988a28aa8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Flow 'volume_create_manager' (2ec21216-e693-437e-b500-2febc630d7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b76b4471-d2ef-4ba9-94dc-3a0fe99eced2 tempest-VolumesImageMetadata-483228699 None] Created volume successfully. Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Acquiring lock "cinder-93d65e5f-b4dc-4902-adff-9fd967f23ce1-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Lock "cinder-93d65e5f-b4dc-4902-adff-9fd967f23ce1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Acquiring lock "cinder-quobyte-93d65e5f-b4dc-4902-adff-9fd967f23ce1" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Lock "cinder-quobyte-93d65e5f-b4dc-4902-adff-9fd967f23ce1" acquired by "delete_volume" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b92ba-c179-466a-b4f0-2a83dcd8d60c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:13 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 Jul 30 16:44:13 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:13 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1" returned: 0 in 0.357s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:13 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1 Jul 30 16:44:13 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:13 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-93d65e5f-b4dc-4902-adff-9fd967f23ce1" returned: 0 in 0.248s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Lock "cinder-quobyte-93d65e5f-b4dc-4902-adff-9fd967f23ce1" released by "delete_volume" :: held 0.643s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Created reservations ['4e95d83d-fb8e-4747-85f4-8a3d7e512679', 'd9760a71-0614-4def-893a-45d8b613402d', '0d444217-78da-4042-a0dc-ba414ff55973', 'f76beeb5-aa21-4052-9aa6-8f62ab4881c3'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:14 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:14 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:14 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.234s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Deleted volume successfully. Jul 30 16:44:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9763a04c-1f9f-49af-af5f-5b2e993e9a2f tempest-VolumesImageMetadata-483228699 None] Lock "cinder-93d65e5f-b4dc-4902-adff-9fd967f23ce1-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:16 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Flow 'volume_create_manager' (a3b051d7-c9e9-485a-91c7-9811148b2281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:16 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c12df35-3ec1-4fc8-8c2e-7820edabf454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c12df35-3ec1-4fc8-8c2e-7820edabf454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-481455389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96c2d0e-c060-4f2a-b748-93303f79fdae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40728ab76db6410280a978dd0910361c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:17Z,use_quota=True,user_id='7d48a1fff2c64528b76a941d07a14d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9528403c-3c91-49b5-8e25-2102496054b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9528403c-3c91-49b5-8e25-2102496054b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c39f1b-b6fe-4845-8d62-6aa2f99ee06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c39f1b-b6fe-4845-8d62-6aa2f99ee06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96c2d0e-c060-4f2a-b748-93303f79fdae', 'volume_name': 'volume-f96c2d0e-c060-4f2a-b748-93303f79fdae', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a0220d-4414-4fff-9d99-2c12548c6c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a0220d-4414-4fff-9d99-2c12548c6c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b882cb28-5b89-4ab8-99ec-4dda99a976ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:17 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Volume f96c2d0e-c060-4f2a-b748-93303f79fdae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96c2d0e-c060-4f2a-b748-93303f79fdae', 'volume_size': 1} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-481455389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96c2d0e-c060-4f2a-b748-93303f79fdae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40728ab76db6410280a978dd0910361c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:17Z,use_quota=True,user_id='7d48a1fff2c64528b76a941d07a14d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Creating volume f96c2d0e-c060-4f2a-b748-93303f79fdae {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:17 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:17 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae 1073741824 Jul 30 16:44:17 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:17 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae 1073741824" returned: 0 in 0.391s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:17 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae Jul 30 16:44:17 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:17 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae" returned: 0 in 0.233s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b882cb28-5b89-4ab8-99ec-4dda99a976ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96c2d0e-c060-4f2a-b748-93303f79fdae', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065c543f-8bb5-4400-a7d7-1ce355934416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:17 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Volume volume-f96c2d0e-c060-4f2a-b748-93303f79fdae (f96c2d0e-c060-4f2a-b748-93303f79fdae): created successfully Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065c543f-8bb5-4400-a7d7-1ce355934416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:17 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Flow 'volume_create_manager' (a3b051d7-c9e9-485a-91c7-9811148b2281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3aaf7b99-a440-4e4f-ad51-de0f655f71b9 tempest-VolumesMetadataTest-226666269 None] Created volume successfully. Jul 30 16:44:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Acquiring lock "cinder-f96c2d0e-c060-4f2a-b748-93303f79fdae-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Lock "cinder-f96c2d0e-c060-4f2a-b748-93303f79fdae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Acquiring lock "cinder-quobyte-f96c2d0e-c060-4f2a-b748-93303f79fdae" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Lock "cinder-quobyte-f96c2d0e-c060-4f2a-b748-93303f79fdae" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:18 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5856eb-b185-4db9-a954-27b13ecad7c0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:18 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae Jul 30 16:44:18 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:19 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae" returned: 0 in 0.365s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:19 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae Jul 30 16:44:19 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:19 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f96c2d0e-c060-4f2a-b748-93303f79fdae" returned: 0 in 0.229s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Lock "cinder-quobyte-f96c2d0e-c060-4f2a-b748-93303f79fdae" released by "delete_volume" :: held 0.629s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Created reservations ['ab2f9ce7-5e26-48ca-948d-b88d20070958', '8b17a1bb-3757-4259-ac0e-8e81ef3771b5', '0a368269-1ad3-4b4a-b61d-58bff2a6dc1b', '53850614-267b-459d-99c5-d6f3b0370bc5'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:19 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:19 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:19 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.235s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:19 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Deleted volume successfully. Jul 30 16:44:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-98cb9b1c-a892-44cb-b16d-03f610299e6a tempest-VolumesMetadataTest-226666269 None] Lock "cinder-f96c2d0e-c060-4f2a-b748-93303f79fdae-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Flow 'volume_create_manager' (64319e4d-d500-42c8-bcbd-a89fd920a0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef81690-e2c9-4d76-89cc-790c2dcb8315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef81690-e2c9-4d76-89cc-790c2dcb8315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-199962102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efbaf77-4de4-45e1-a6c8-306e691ff959,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed5730408574769a47550b4177fdf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:22Z,use_quota=True,user_id='e26d1228dbbd45089df96ab413b1d15d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf4d36-f76d-4682-a9f6-3c43cef2118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf4d36-f76d-4682-a9f6-3c43cef2118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906641b6-bdc1-4686-9c06-00e08e3bc69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906641b6-bdc1-4686-9c06-00e08e3bc69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efbaf77-4de4-45e1-a6c8-306e691ff959', 'volume_name': 'volume-7efbaf77-4de4-45e1-a6c8-306e691ff959', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fca17b-3395-4f0f-8a7c-42ce509f912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fca17b-3395-4f0f-8a7c-42ce509f912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c01e1b-d940-4486-a339-061a5cd1b392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:22 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Volume 7efbaf77-4de4-45e1-a6c8-306e691ff959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efbaf77-4de4-45e1-a6c8-306e691ff959', 'volume_size': 1} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-199962102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efbaf77-4de4-45e1-a6c8-306e691ff959,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed5730408574769a47550b4177fdf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:22Z,use_quota=True,user_id='e26d1228dbbd45089df96ab413b1d15d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Creating volume 7efbaf77-4de4-45e1-a6c8-306e691ff959 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:22 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:44:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:22 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 1073741824 Jul 30 16:44:22 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:23 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 1073741824" returned: 0 in 0.446s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:23 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 Jul 30 16:44:23 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:23 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959" returned: 0 in 0.248s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c01e1b-d940-4486-a339-061a5cd1b392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efbaf77-4de4-45e1-a6c8-306e691ff959', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09fa9637-3f5e-43ce-afe4-4079b9a9c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:23 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Volume volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 (7efbaf77-4de4-45e1-a6c8-306e691ff959): created successfully Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09fa9637-3f5e-43ce-afe4-4079b9a9c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:23 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Flow 'volume_create_manager' (64319e4d-d500-42c8-bcbd-a89fd920a0ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:23 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c6c6f1d6-b67b-42c3-910e-b0632cdfe514 tempest-VolumesListTestJSON-1102454950 None] Created volume successfully. Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Flow 'volume_create_manager' (f2a00056-4c49-49fa-9907-557ebad41e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff3a217-09d5-435e-b985-fe3ffaf4c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff3a217-09d5-435e-b985-fe3ffaf4c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1372272824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec29f937-60ab-407a-893e-0584ad6314be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed5730408574769a47550b4177fdf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:24Z,use_quota=True,user_id='e26d1228dbbd45089df96ab413b1d15d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b45b143-556d-4899-8ae4-2ba14a091320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b45b143-556d-4899-8ae4-2ba14a091320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af74d0b-f140-47d8-9410-4451d2492890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af74d0b-f140-47d8-9410-4451d2492890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec29f937-60ab-407a-893e-0584ad6314be', 'volume_name': 'volume-ec29f937-60ab-407a-893e-0584ad6314be', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeadd3a2-98cc-4e67-ac13-ac22a41348f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeadd3a2-98cc-4e67-ac13-ac22a41348f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ce3833-345e-409f-be61-8991b0ea2510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:24 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Volume ec29f937-60ab-407a-893e-0584ad6314be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec29f937-60ab-407a-893e-0584ad6314be', 'volume_size': 1} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1372272824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec29f937-60ab-407a-893e-0584ad6314be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed5730408574769a47550b4177fdf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:24Z,use_quota=True,user_id='e26d1228dbbd45089df96ab413b1d15d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Creating volume ec29f937-60ab-407a-893e-0584ad6314be {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:24 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:24 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be 1073741824 Jul 30 16:44:24 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:24 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be 1073741824" returned: 0 in 0.408s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:24 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be Jul 30 16:44:24 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:24 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be" returned: 0 in 0.252s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ce3833-345e-409f-be61-8991b0ea2510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec29f937-60ab-407a-893e-0584ad6314be', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc92fad-8009-4935-9f83-d05ad7c22b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:24 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Volume volume-ec29f937-60ab-407a-893e-0584ad6314be (ec29f937-60ab-407a-893e-0584ad6314be): created successfully Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc92fad-8009-4935-9f83-d05ad7c22b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Flow 'volume_create_manager' (f2a00056-4c49-49fa-9907-557ebad41e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:24 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ef38fd37-2f14-403f-8a25-5edad0f04603 tempest-VolumesListTestJSON-1102454950 None] Created volume successfully. Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Flow 'volume_create_manager' (c8067e9b-7846-4d38-a55a-368f8e06edfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f91519-e974-4b5d-abbc-bdbebdab5783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f91519-e974-4b5d-abbc-bdbebdab5783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2029668267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5910c9ab-2d5e-47d5-bc03-489b05879a34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed5730408574769a47550b4177fdf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:26Z,use_quota=True,user_id='e26d1228dbbd45089df96ab413b1d15d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b295b6ec-cc16-4967-91e7-22240b7a97f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b295b6ec-cc16-4967-91e7-22240b7a97f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d85325d-2bc8-4d5a-a6f2-692dab01c058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d85325d-2bc8-4d5a-a6f2-692dab01c058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5910c9ab-2d5e-47d5-bc03-489b05879a34', 'volume_name': 'volume-5910c9ab-2d5e-47d5-bc03-489b05879a34', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f255c3c-9660-4eca-983c-f0be458755d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f255c3c-9660-4eca-983c-f0be458755d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0173b3-e33f-4aee-9284-34fe5d02022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:25 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Volume 5910c9ab-2d5e-47d5-bc03-489b05879a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5910c9ab-2d5e-47d5-bc03-489b05879a34', 'volume_size': 1} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2029668267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5910c9ab-2d5e-47d5-bc03-489b05879a34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed5730408574769a47550b4177fdf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:26Z,use_quota=True,user_id='e26d1228dbbd45089df96ab413b1d15d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Creating volume 5910c9ab-2d5e-47d5-bc03-489b05879a34 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:25 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:44:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:25 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 1073741824 Jul 30 16:44:25 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:26 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 1073741824" returned: 0 in 0.408s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:26 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 Jul 30 16:44:26 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:26 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34" returned: 0 in 0.234s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0173b3-e33f-4aee-9284-34fe5d02022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5910c9ab-2d5e-47d5-bc03-489b05879a34', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1308ccfe-85a6-459d-8e85-4a2dc67ef251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:26 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Volume volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 (5910c9ab-2d5e-47d5-bc03-489b05879a34): created successfully Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1308ccfe-85a6-459d-8e85-4a2dc67ef251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Flow 'volume_create_manager' (c8067e9b-7846-4d38-a55a-368f8e06edfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:26 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-95fccc9b-47bc-4aa1-befd-92b48a40d4da tempest-VolumesListTestJSON-1102454950 None] Created volume successfully. Jul 30 16:44:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "cinder-5910c9ab-2d5e-47d5-bc03-489b05879a34-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-5910c9ab-2d5e-47d5-bc03-489b05879a34-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "cinder-quobyte-5910c9ab-2d5e-47d5-bc03-489b05879a34" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-quobyte-5910c9ab-2d5e-47d5-bc03-489b05879a34" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:28 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19f912f-1426-4722-a81d-d0a4f3e5430f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:28 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 Jul 30 16:44:28 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:29 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34" returned: 0 in 0.356s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:29 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34 Jul 30 16:44:29 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:29 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5910c9ab-2d5e-47d5-bc03-489b05879a34" returned: 0 in 0.240s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-quobyte-5910c9ab-2d5e-47d5-bc03-489b05879a34" released by "delete_volume" :: held 0.639s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Created reservations ['586212d7-e824-4545-b914-b5681d1c91f1', '4f5a26da-4f65-45a1-8d0b-ede7b5a0295e', 'e5e653da-0fef-4240-a9c6-0ff2a2a03b07', 'adeb0b00-5fae-4d57-bd45-f8d8c2df4c13'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:29 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:29 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:29 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.243s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:29 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Deleted volume successfully. Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05dcb01d-0fde-42bd-a43c-7802712c99f3 tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-5910c9ab-2d5e-47d5-bc03-489b05879a34-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "cinder-ec29f937-60ab-407a-893e-0584ad6314be-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-ec29f937-60ab-407a-893e-0584ad6314be-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "cinder-quobyte-ec29f937-60ab-407a-893e-0584ad6314be" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-quobyte-ec29f937-60ab-407a-893e-0584ad6314be" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb77e36e-821f-47b4-803b-c10925d2e8c5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:29 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be Jul 30 16:44:29 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:30 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:30 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be Jul 30 16:44:30 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:30 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ec29f937-60ab-407a-893e-0584ad6314be" returned: 0 in 0.235s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-quobyte-ec29f937-60ab-407a-893e-0584ad6314be" released by "delete_volume" :: held 0.640s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Created reservations ['59016682-25b6-42fe-8436-82a6014e463e', '10a75bce-8607-487c-9f11-7c443220e8d1', '4002f7d5-d4e5-4d90-b27e-709c49f34782', 'a7c14a85-d67c-4897-a5f1-fb9d44fe6363'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:30 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:30 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:30 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.243s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Deleted volume successfully. Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-409d7aed-3de6-46ce-9690-b83f9981513c tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-ec29f937-60ab-407a-893e-0584ad6314be-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "cinder-7efbaf77-4de4-45e1-a6c8-306e691ff959-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-7efbaf77-4de4-45e1-a6c8-306e691ff959-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "cinder-quobyte-7efbaf77-4de4-45e1-a6c8-306e691ff959" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-quobyte-7efbaf77-4de4-45e1-a6c8-306e691ff959" acquired by "delete_volume" :: waited 0.013s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835ebb7-495b-45af-ae21-44f35506a223]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:31 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 Jul 30 16:44:31 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:31 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959" returned: 0 in 0.338s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:31 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959 Jul 30 16:44:31 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:31 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7efbaf77-4de4-45e1-a6c8-306e691ff959" returned: 0 in 0.233s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-quobyte-7efbaf77-4de4-45e1-a6c8-306e691ff959" released by "delete_volume" :: held 0.608s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Created reservations ['47d11224-4b80-4c18-a6ca-7c554e0cfb06', '8409f491-6770-4694-b1a5-9ae196766e88', '64ef48a7-a0d4-47ad-a9c1-a32641080ada', '92567886-fbf8-4b34-b673-a0f27d5db746'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:31 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:31 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:32 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.260s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:32 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Deleted volume successfully. Jul 30 16:44:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-19666116-ea83-4a29-ab8c-6ef47f13e276 tempest-VolumesListTestJSON-1102454950 None] Lock "cinder-7efbaf77-4de4-45e1-a6c8-306e691ff959-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:41 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:INSERT=25,cinder:SELECT=46,cinder:UPDATE=72,cinder:DELETE=5 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:44:42 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=39,cinder:INSERT=18,cinder:UPDATE=49,cinder:DELETE=6 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:47 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:44:47 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:47 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.246s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:44:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Flow 'volume_create_manager' (442a2b69-3f23-44a0-b73f-b3d06aab0ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6544d85e-8d1f-4338-94e7-36e011b3c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6544d85e-8d1f-4338-94e7-36e011b3c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-990137355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb0555a-86f0-4c2c-a367-667ec8751867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794bc43730a4849867daff594b572ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:53Z,use_quota=True,user_id='54fae94f0027444889af70790802ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12e8349-2e67-449f-9a44-af3d8f9b7819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12e8349-2e67-449f-9a44-af3d8f9b7819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665c3e95-4f2a-49dd-8125-6bcde681f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665c3e95-4f2a-49dd-8125-6bcde681f985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb0555a-86f0-4c2c-a367-667ec8751867', 'volume_name': 'volume-dcb0555a-86f0-4c2c-a367-667ec8751867', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a583ab-17db-4622-9717-93e2793c0f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a583ab-17db-4622-9717-93e2793c0f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56bc39c-bdda-44a5-9288-cfe6073dc50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Volume dcb0555a-86f0-4c2c-a367-667ec8751867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb0555a-86f0-4c2c-a367-667ec8751867', 'volume_size': 1} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-990137355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb0555a-86f0-4c2c-a367-667ec8751867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794bc43730a4849867daff594b572ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:53Z,use_quota=True,user_id='54fae94f0027444889af70790802ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Creating volume dcb0555a-86f0-4c2c-a367-667ec8751867 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:53 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:53 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 1073741824 Jul 30 16:44:53 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Flow 'volume_create_manager' (ee2ae97e-6cad-42ed-b25e-2de80f696075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdca7d86-dd79-41c6-a453-4cac11a27936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdca7d86-dd79-41c6-a453-4cac11a27936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-4232765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feec39ae-3f7c-47dc-91a1-20703a7798dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794bc43730a4849867daff594b572ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:53Z,use_quota=True,user_id='54fae94f0027444889af70790802ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9f4792-c23d-467c-aedb-3c755c083a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9f4792-c23d-467c-aedb-3c755c083a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a1fe4b-fecd-42e4-8d50-a2b29a9f006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a1fe4b-fecd-42e4-8d50-a2b29a9f006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feec39ae-3f7c-47dc-91a1-20703a7798dd', 'volume_name': 'volume-feec39ae-3f7c-47dc-91a1-20703a7798dd', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cd21ff-b454-4e4c-bfbe-02797630135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cd21ff-b454-4e4c-bfbe-02797630135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc15963d-cbf9-440a-aa75-e261f67d4fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Volume feec39ae-3f7c-47dc-91a1-20703a7798dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feec39ae-3f7c-47dc-91a1-20703a7798dd', 'volume_size': 1} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:53 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 1073741824" returned: 0 in 0.519s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:53 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 Jul 30 16:44:53 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:53 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867" returned: 0 in 0.268s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-4232765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feec39ae-3f7c-47dc-91a1-20703a7798dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794bc43730a4849867daff594b572ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:53Z,use_quota=True,user_id='54fae94f0027444889af70790802ba2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Creating volume feec39ae-3f7c-47dc-91a1-20703a7798dd {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:53 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56bc39c-bdda-44a5-9288-cfe6073dc50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb0555a-86f0-4c2c-a367-667ec8751867', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19398c5b-0dc2-4124-b8db-1df3c2f83689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:53 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd 1073741824 Jul 30 16:44:53 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:54 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Volume volume-dcb0555a-86f0-4c2c-a367-667ec8751867 (dcb0555a-86f0-4c2c-a367-667ec8751867): created successfully Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19398c5b-0dc2-4124-b8db-1df3c2f83689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Flow 'volume_create_manager' (442a2b69-3f23-44a0-b73f-b3d06aab0ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b96dd0af-22fd-4c60-a28a-758e3fa322e1 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Created volume successfully. Jul 30 16:44:54 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd 1073741824" returned: 0 in 0.521s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:54 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd Jul 30 16:44:54 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:54 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd" returned: 0 in 0.265s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc15963d-cbf9-440a-aa75-e261f67d4fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feec39ae-3f7c-47dc-91a1-20703a7798dd', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e60a2a7-f927-4c9a-8f64-11cce74f04ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:54 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Volume volume-feec39ae-3f7c-47dc-91a1-20703a7798dd (feec39ae-3f7c-47dc-91a1-20703a7798dd): created successfully Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e60a2a7-f927-4c9a-8f64-11cce74f04ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:54 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Flow 'volume_create_manager' (ee2ae97e-6cad-42ed-b25e-2de80f696075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-790cdba7-32a7-4366-a9fe-2716393797d6 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Created volume successfully. Jul 30 16:45:04 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:45:04 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:45:21 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:45:21 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:45:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-03de5854-7109-46d7-ab6b-bf2019c7c1e5 req-46e3391f-8961-48c5-8b9c-8cd239391aa0 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-03de5854-7109-46d7-ab6b-bf2019c7c1e5 req-46e3391f-8961-48c5-8b9c-8cd239391aa0 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-03de5854-7109-46d7-ab6b-bf2019c7c1e5 req-46e3391f-8961-48c5-8b9c-8cd239391aa0 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-03de5854-7109-46d7-ab6b-bf2019c7c1e5 req-46e3391f-8961-48c5-8b9c-8cd239391aa0 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-dcb0555a-86f0-4c2c-a367-667ec8751867', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0e6a9d9-394f-44d8-912c-2afc647d5a72', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:45:25 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-03de5854-7109-46d7-ab6b-bf2019c7c1e5 req-46e3391f-8961-48c5-8b9c-8cd239391aa0 tempest-TestServerVolumeAttachmentScenario-1952279790 None] attachment_update completed successfully. Jul 30 16:45:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-a6836ba3-73b5-4297-915c-e3a1af79b05f req-b05ac853-ccbc-40bd-8c90-214aa46b1d09 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-a6836ba3-73b5-4297-915c-e3a1af79b05f req-b05ac853-ccbc-40bd-8c90-214aa46b1d09 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [req-a6836ba3-73b5-4297-915c-e3a1af79b05f req-b05ac853-ccbc-40bd-8c90-214aa46b1d09 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-a6836ba3-73b5-4297-915c-e3a1af79b05f req-b05ac853-ccbc-40bd-8c90-214aa46b1d09 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11', 'name': 'volume-feec39ae-3f7c-47dc-91a1-20703a7798dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78cb9a04-91dc-456c-80da-de9f4a22f57d', 'enforce_multipath': True} {{(pid=88095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:45:29 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-a6836ba3-73b5-4297-915c-e3a1af79b05f req-b05ac853-ccbc-40bd-8c90-214aa46b1d09 tempest-TestServerVolumeAttachmentScenario-1952279790 None] attachment_update completed successfully. Jul 30 16:45:31 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-fc712764-d71c-4746-9b91-8eabe8d94fb4 req-6baea3a4-0b94-407d-8bc3-0ec7e8ab5f5e tempest-TestServerVolumeAttachmentScenario-1952279790 None] Terminate volume connection completed successfully. Jul 30 16:45:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-fc712764-d71c-4746-9b91-8eabe8d94fb4 req-6baea3a4-0b94-407d-8bc3-0ec7e8ab5f5e tempest-TestServerVolumeAttachmentScenario-1952279790 None] Deleting attachment 78cb9a04-91dc-456c-80da-de9f4a22f57d. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:45:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [req-ffcc6df3-03ec-4847-947f-c051ae1a9670 req-0e1bcb5f-17d7-420b-925b-6854afba0be4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Terminate volume connection completed successfully. Jul 30 16:45:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [req-ffcc6df3-03ec-4847-947f-c051ae1a9670 req-0e1bcb5f-17d7-420b-925b-6854afba0be4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Deleting attachment e0e6a9d9-394f-44d8-912c-2afc647d5a72. {{(pid=88095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "cinder-feec39ae-3f7c-47dc-91a1-20703a7798dd-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "cinder-feec39ae-3f7c-47dc-91a1-20703a7798dd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "cinder-quobyte-feec39ae-3f7c-47dc-91a1-20703a7798dd" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "cinder-quobyte-feec39ae-3f7c-47dc-91a1-20703a7798dd" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a58a47-7b1b-4d71-a064-91373419275f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:37 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd Jul 30 16:45:37 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:37 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd" returned: 0 in 0.354s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:37 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd Jul 30 16:45:37 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:37 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-feec39ae-3f7c-47dc-91a1-20703a7798dd" returned: 0 in 0.252s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "cinder-quobyte-feec39ae-3f7c-47dc-91a1-20703a7798dd" released by "delete_volume" :: held 0.645s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:37 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Created reservations ['7e4e3993-caf4-4ad4-8e37-af9b1dbe0bbf', '6cc9a1d2-83a0-439b-b4c8-4d894a2a53a8', '2091f415-2340-4621-b714-05b3070c4a6e', '3f80d346-98ba-420b-b99a-6c14938bbfaf'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:38 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:45:38 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:38 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.230s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Deleted volume successfully. Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6df08dd-9e8d-4de5-92dc-f26dc71b51a4 tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "cinder-feec39ae-3f7c-47dc-91a1-20703a7798dd-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "cinder-dcb0555a-86f0-4c2c-a367-667ec8751867-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "cinder-dcb0555a-86f0-4c2c-a367-667ec8751867-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "cinder-quobyte-dcb0555a-86f0-4c2c-a367-667ec8751867" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "cinder-quobyte-dcb0555a-86f0-4c2c-a367-667ec8751867" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71bc3d-ddae-4318-add3-1994e3920239]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:38 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 Jul 30 16:45:38 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:38 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867" returned: 0 in 0.405s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:38 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867 Jul 30 16:45:38 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:39 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-dcb0555a-86f0-4c2c-a367-667ec8751867" returned: 0 in 0.278s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "cinder-quobyte-dcb0555a-86f0-4c2c-a367-667ec8751867" released by "delete_volume" :: held 0.730s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Created reservations ['24ac8624-92e8-471f-8bc6-0cfee56e371b', '05c84b95-08b0-4626-b594-b63801588725', 'dbf1b05b-f084-46c9-93d8-13e1467b792f', '426e8440-841e-4d3d-b1ad-6f9aa9253226'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:39 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:45:39 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:39 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.271s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Deleted volume successfully. Jul 30 16:45:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-40881a79-be76-4126-9dcb-dd12e33af79c tempest-TestServerVolumeAttachmentScenario-1952279790 None] Lock "cinder-dcb0555a-86f0-4c2c-a367-667ec8751867-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:47 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:45:47 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:47 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.284s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:45:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Flow 'volume_create_manager' (cdd3b4fa-b3be-494f-bc03-66166eaa71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5182eeb5-3682-49b3-a97f-6c74f635a432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5182eeb5-3682-49b3-a97f-6c74f635a432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048308742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fc8282-21c0-452e-b709-29aba885a148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d459e50969a049da9faa9c0e11bc43c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:49Z,use_quota=True,user_id='5bb930084f2244f88535cf99cfcbb544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c57269a-c5a2-4d25-adc8-85bcf47d9518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c57269a-c5a2-4d25-adc8-85bcf47d9518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeceae1-9580-419b-81b2-f96248a30475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeceae1-9580-419b-81b2-f96248a30475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fc8282-21c0-452e-b709-29aba885a148', 'volume_name': 'volume-f6fc8282-21c0-452e-b709-29aba885a148', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8549022-6618-4ba5-bb4e-5b0c3eef7998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8549022-6618-4ba5-bb4e-5b0c3eef7998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60180859-8c5d-4d46-bf77-f45fd9efc321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Volume f6fc8282-21c0-452e-b709-29aba885a148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fc8282-21c0-452e-b709-29aba885a148', 'volume_size': 1} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048308742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fc8282-21c0-452e-b709-29aba885a148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d459e50969a049da9faa9c0e11bc43c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:49Z,use_quota=True,user_id='5bb930084f2244f88535cf99cfcbb544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Creating volume f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:49 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:49 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 1073741824 Jul 30 16:45:49 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:49 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 1073741824" returned: 0 in 0.405s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:49 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 Jul 30 16:45:49 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:49 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148" returned: 0 in 0.237s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60180859-8c5d-4d46-bf77-f45fd9efc321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fc8282-21c0-452e-b709-29aba885a148', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a8358e-33a2-4240-84a3-60e820772ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Volume volume-f6fc8282-21c0-452e-b709-29aba885a148 (f6fc8282-21c0-452e-b709-29aba885a148): created successfully Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a8358e-33a2-4240-84a3-60e820772ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Flow 'volume_create_manager' (cdd3b4fa-b3be-494f-bc03-66166eaa71b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3e83400b-0956-4176-aece-fea382e2da32 tempest-VolumeDependencyTests-1538532306 None] Created volume successfully. Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Creating offline snapshot 722a82b4-8bd8-423e-8a9f-e0e2dc529d30 of volume f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bcaae1-cf2d-489e-bae8-3fae73f8c0b8]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:50 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 Jul 30 16:45:50 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:50 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148" returned: 0 in 0.337s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:50 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 1G Jul 30 16:45:50 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:50 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 1G" returned: 0 in 0.388s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fc8282-21c0-452e-b709-29aba885a148 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:50 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fc8282-21c0-452e-b709-29aba885a148 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 Jul 30 16:45:50 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:51 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fc8282-21c0-452e-b709-29aba885a148 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30" returned: 0 in 0.290s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:51 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 is being set with open permissions: ugo+rw Jul 30 16:45:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:51 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 Jul 30 16:45:51 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:51 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30" returned: 0 in 0.242s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:51 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.info Jul 30 16:45:51 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:51 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.info" returned: 0 in 0.254s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:51 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.info is being set with open permissions: ugo+rw Jul 30 16:45:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:51 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.info Jul 30 16:45:51 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:52 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.info" returned: 0 in 0.248s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-126f0e6e-51e1-4733-8104-06264a1a0e56 tempest-VolumeDependencyTests-1538532306 None] Create snapshot completed successfully Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Flow 'volume_create_manager' (d2b10885-505d-4f36-b0ef-b82946d8d476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167af676-9ccc-4c1c-80f3-6af3b353eaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167af676-9ccc-4c1c-80f3-6af3b353eaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1180736688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51d75bd-4cc0-4dfe-9b07-d5e5397703a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d459e50969a049da9faa9c0e11bc43c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=722a82b4-8bd8-423e-8a9f-e0e2dc529d30,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:53Z,use_quota=True,user_id='5bb930084f2244f88535cf99cfcbb544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b59532-2437-44a6-b10e-56a2712fc33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b59532-2437-44a6-b10e-56a2712fc33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e20a3f-e805-4184-b397-6b9f60888461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e20a3f-e805-4184-b397-6b9f60888461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c51d75bd-4cc0-4dfe-9b07-d5e5397703a6', 'volume_name': 'volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6', 'volume_size': 1, 'snapshot_id': '722a82b4-8bd8-423e-8a9f-e0e2dc529d30'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161e9870-e108-4bb6-8bb4-a598683479fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161e9870-e108-4bb6-8bb4-a598683479fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3ce7a6-d6c8-4c9b-a5c2-470056291b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:52 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Volume c51d75bd-4cc0-4dfe-9b07-d5e5397703a6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6', 'volume_size': 1, 'snapshot_id': '722a82b4-8bd8-423e-8a9f-e0e2dc529d30'} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-quobyte-722a82b4-8bd8-423e-8a9f-e0e2dc529d30-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-722a82b4-8bd8-423e-8a9f-e0e2dc529d30-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Creating volume c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 from snapshot 722a82b4-8bd8-423e-8a9f-e0e2dc529d30 {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-quobyte-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] snapshot: 722a82b4-8bd8-423e-8a9f-e0e2dc529d30, volume: c51d75bd-4cc0-4dfe-9b07-d5e5397703a6, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceff87d6-a603-4c7e-a9a5-451b444b3a6c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:53 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 Jul 30 16:45:53 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:53 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30" returned: 0 in 0.362s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fc8282-21c0-452e-b709-29aba885a148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b684c16e-3175-43de-99c5-5a827a81116d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:53 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 Jul 30 16:45:53 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:53 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148" returned: 0 in 0.361s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:45:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:53 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 Jul 30 16:45:53 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:57 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" returned: 0 in 3.802s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148, size 1024.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:45:57 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Converted 1024.00 MB image at 269.27 MB/s Jul 30 16:45:57 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 is being set with open permissions: ugo+rw Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:57 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 Jul 30 16:45:57 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:57 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" returned: 0 in 0.225s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" released by "_copy_volume_from_snapshot" :: held 4.821s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-722a82b4-8bd8-423e-8a9f-e0e2dc529d30-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" released by "_create_volume_from_snapshot" :: held 4.882s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.897s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3ce7a6-d6c8-4c9b-a5c2-470056291b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6', 'volume_size': 1, 'snapshot_id': '722a82b4-8bd8-423e-8a9f-e0e2dc529d30'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e73157c-bf1b-4b67-944f-cc4ec7b5f4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:57 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Volume volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 (c51d75bd-4cc0-4dfe-9b07-d5e5397703a6): created successfully Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e73157c-bf1b-4b67-944f-cc4ec7b5f4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Flow 'volume_create_manager' (d2b10885-505d-4f36-b0ef-b82946d8d476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:57 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-06849686-a7ba-4b6b-8a98-0dcce7ecf124 tempest-VolumeDependencyTests-1538532306 None] Created volume successfully. Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-722a82b4-8bd8-423e-8a9f-e0e2dc529d30-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-722a82b4-8bd8-423e-8a9f-e0e2dc529d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-quobyte-f6fc8282-21c0-452e-b709-29aba885a148" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-f6fc8282-21c0-452e-b709-29aba885a148" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-quobyte-722a82b4-8bd8-423e-8a9f-e0e2dc529d30" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-722a82b4-8bd8-423e-8a9f-e0e2dc529d30" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Deleting offline snapshot 722a82b4-8bd8-423e-8a9f-e0e2dc529d30 of volume f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] snapshot_file for this snap is: volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69f27f2-c8e7-4ecd-a0b4-336f17cd6c52]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:58 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 Jul 30 16:45:58 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:58 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30" returned: 0 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fc8282-21c0-452e-b709-29aba885a148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec4b7ce-e713-4c6c-ac1f-4fe1a96c3773]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:58 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 Jul 30 16:45:58 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:59 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148" returned: 0 in 0.519s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:59 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 Jul 30 16:45:59 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:59 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30" returned: 0 in 0.328s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:59 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30 Jul 30 16:45:59 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:59 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148.722a82b4-8bd8-423e-8a9f-e0e2dc529d30" returned: 0 in 0.247s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-722a82b4-8bd8-423e-8a9f-e0e2dc529d30" released by "_delete_snapshot" :: held 1.536s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-f6fc8282-21c0-452e-b709-29aba885a148" released by "delete_snapshot" :: held 1.555s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Created reservations ['c2051edb-f553-4abd-acab-0df2cfd7456e', 'a3b9db3c-626a-421a-afe6-4d3298925dcd', 'c5caccb7-6fd4-47c5-96da-68fb2a734df9', 'b35153f0-0929-4a9a-8f51-ae551c9a2fe1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Delete snapshot completed successfully. Jul 30 16:45:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-17ec63c7-f75b-4287-9bc0-93595b5c0b51 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-722a82b4-8bd8-423e-8a9f-e0e2dc529d30-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-f6fc8282-21c0-452e-b709-29aba885a148-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-f6fc8282-21c0-452e-b709-29aba885a148-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-quobyte-f6fc8282-21c0-452e-b709-29aba885a148" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-f6fc8282-21c0-452e-b709-29aba885a148" acquired by "delete_volume" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dc95fc-bdff-48b8-88d5-0d3628c5bc24]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:00 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 Jul 30 16:46:00 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:00 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148" returned: 0 in 0.334s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:00 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148 Jul 30 16:46:00 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:01 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-f6fc8282-21c0-452e-b709-29aba885a148" returned: 0 in 0.225s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-f6fc8282-21c0-452e-b709-29aba885a148" released by "delete_volume" :: held 0.612s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Created reservations ['32e1e9fa-590c-4eac-9b57-704bd34456b5', '31f813da-1f9a-4d5b-abab-74755841e6e4', '234eb4dc-c50f-489b-9337-e79afae2f14b', '045ba4b4-21c4-4d29-a689-4aa542341a42'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:01 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:01 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:01 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.234s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Deleted volume successfully. Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-047c1523-fe00-401c-8926-b28e81efeba8 tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-f6fc8282-21c0-452e-b709-29aba885a148-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "cinder-quobyte-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fdfacf-5288-4ec4-b158-077b94b3e8f9]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:01 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 Jul 30 16:46:01 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:02 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" returned: 0 in 0.355s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:02 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6 Jul 30 16:46:02 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:02 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" returned: 0 in 0.240s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-quobyte-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6" released by "delete_volume" :: held 0.630s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Created reservations ['d439867f-89a6-4105-9743-01246d8412d5', '0b68a2c8-6f6b-477a-8fae-34a249e702cc', '2b6db51a-cb61-4af5-93bc-629ed0775ebd', 'b6e0605b-35f5-45f3-8f8c-047f17b0a9b7'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:02 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:02 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:02 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.236s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Deleted volume successfully. Jul 30 16:46:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dea4cf8c-c5d2-4d28-8861-dc2b806c492e tempest-VolumeDependencyTests-1538532306 None] Lock "cinder-c51d75bd-4cc0-4dfe-9b07-d5e5397703a6-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:12 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=50,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=2 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:46:12 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=49,cinder:UPDATE=44,cinder:INSERT=8,cinder:DELETE=5 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (a5a35180-ae6a-4c39-b218-759c36633970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4591053-51a3-4932-90b4-59045aca89db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4591053-51a3-4932-90b4-59045aca89db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852577505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be8282d-4d5b-4b03-a07d-9680bf714289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:24Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c4171b-c5bc-4116-bf90-e4dacc182a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c4171b-c5bc-4116-bf90-e4dacc182a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d4efc0-e14a-43bb-bdcd-41c7ebae5dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d4efc0-e14a-43bb-bdcd-41c7ebae5dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be8282d-4d5b-4b03-a07d-9680bf714289', 'volume_name': 'volume-7be8282d-4d5b-4b03-a07d-9680bf714289', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92265fee-2a83-4088-aeb9-e566f1ec1e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92265fee-2a83-4088-aeb9-e566f1ec1e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97011b08-06cb-4130-888b-a832f7c8d8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume 7be8282d-4d5b-4b03-a07d-9680bf714289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be8282d-4d5b-4b03-a07d-9680bf714289', 'volume_size': 1} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852577505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be8282d-4d5b-4b03-a07d-9680bf714289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:24Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Creating volume 7be8282d-4d5b-4b03-a07d-9680bf714289 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:24 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:24 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 1073741824 Jul 30 16:46:24 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (bd453efc-f3e2-44a9-820b-6cdfbeb83b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316503f8-82f2-4491-849b-9c214508dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316503f8-82f2-4491-849b-9c214508dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-766999648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f62a6b4-425c-4780-b6fc-dc34f69900b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:24Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3871be44-1d12-43c6-96b7-fec1dc1efd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3871be44-1d12-43c6-96b7-fec1dc1efd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac46daa-289d-4bb9-be63-fb4b9a9568ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac46daa-289d-4bb9-be63-fb4b9a9568ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f62a6b4-425c-4780-b6fc-dc34f69900b6', 'volume_name': 'volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58cfd0f-c108-4bd2-9770-e6a12c03cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58cfd0f-c108-4bd2-9770-e6a12c03cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924d8c86-e6bf-4e9b-b830-fcd098768522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Volume 0f62a6b4-425c-4780-b6fc-dc34f69900b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6', 'volume_size': 1} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (dc6a8278-b348-4e52-988f-5796943dc508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43bb41de-4460-46f5-9a85-65d024c2e018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43bb41de-4460-46f5-9a85-65d024c2e018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502958604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d98e25e-be96-4e75-9469-d7ce1c82b17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:25Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b2a806-2e45-4c8b-8bb5-f8214b011b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b2a806-2e45-4c8b-8bb5-f8214b011b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b10291b-4b49-4a84-93aa-61ebc8b332f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b10291b-4b49-4a84-93aa-61ebc8b332f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d98e25e-be96-4e75-9469-d7ce1c82b17f', 'volume_name': 'volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9b8359-f7b5-4a84-bbc4-bcf6ece8eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9b8359-f7b5-4a84-bbc4-bcf6ece8eecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b063838-863b-463e-94cb-00bd513b3bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Volume 5d98e25e-be96-4e75-9469-d7ce1c82b17f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f', 'volume_size': 1} Jul 30 16:46:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:25 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 1073741824" returned: 0 in 0.839s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (41cf2925-5bea-492c-a54b-7c22c20bc0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41d0cd2-6775-4d81-b023-80320d352a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41d0cd2-6775-4d81-b023-80320d352a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-756772019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5929e8a-882e-48d0-aaf0-2c29ff659df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:25Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 Jul 30 16:46:25 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bf8939-1c9d-4cfd-999b-0cada0f87c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bf8939-1c9d-4cfd-999b-0cada0f87c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dce2abc-e91f-45ed-bdba-435e2666eda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dce2abc-e91f-45ed-bdba-435e2666eda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5929e8a-882e-48d0-aaf0-2c29ff659df4', 'volume_name': 'volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed5d93f-4221-4f5c-a464-b3bce46eed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed5d93f-4221-4f5c-a464-b3bce46eed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a37047-c404-4735-b51f-155f6dccfef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Volume c5929e8a-882e-48d0-aaf0-2c29ff659df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4', 'volume_size': 1} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:25 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289" returned: 0 in 0.336s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-766999648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f62a6b4-425c-4780-b6fc-dc34f69900b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:24Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Creating volume 0f62a6b4-425c-4780-b6fc-dc34f69900b6 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:25 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:25 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 1073741824 Jul 30 16:46:25 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97011b08-06cb-4130-888b-a832f7c8d8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be8282d-4d5b-4b03-a07d-9680bf714289', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02b3083-a464-4ad3-a649-30b9732dc245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume volume-7be8282d-4d5b-4b03-a07d-9680bf714289 (7be8282d-4d5b-4b03-a07d-9680bf714289): created successfully Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02b3083-a464-4ad3-a649-30b9732dc245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (a5a35180-ae6a-4c39-b218-759c36633970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (8936c867-261e-4151-930f-88283c89614b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932c16a7-f08e-4e19-ac73-71ab2d60f394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-dd7f5848-3f12-408d-b538-bb7be31f236b tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created volume successfully. Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932c16a7-f08e-4e19-ac73-71ab2d60f394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1324407959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb14f5a2-6907-48a6-acee-f0c907161713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:26Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16d76ed-55fe-436d-95ad-1265f28725aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16d76ed-55fe-436d-95ad-1265f28725aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db220d21-31ca-4794-a419-e223f31b4b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db220d21-31ca-4794-a419-e223f31b4b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb14f5a2-6907-48a6-acee-f0c907161713', 'volume_name': 'volume-fb14f5a2-6907-48a6-acee-f0c907161713', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3081ee90-c369-4cde-aee0-6176e51e038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3081ee90-c369-4cde-aee0-6176e51e038c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81429427-804a-4b92-ad5a-822123ad45ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Volume fb14f5a2-6907-48a6-acee-f0c907161713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb14f5a2-6907-48a6-acee-f0c907161713', 'volume_size': 1} Jul 30 16:46:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (2585a22f-6247-4f25-a731-d7cc0ef7de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9396fa4-e849-42a4-95de-70cffc4a13e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9396fa4-e849-42a4-95de-70cffc4a13e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2125720867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8279bb-b4ad-42b8-8e2d-d9562df493fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:26Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b712c1f-45a6-405e-b059-5e9ad4bd4c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b712c1f-45a6-405e-b059-5e9ad4bd4c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb2ef10-bf31-454b-a0d6-b70db7daed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb2ef10-bf31-454b-a0d6-b70db7daed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8279bb-b4ad-42b8-8e2d-d9562df493fe', 'volume_name': 'volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899cb9e6-16ff-4203-8b67-d099258e2ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899cb9e6-16ff-4203-8b67-d099258e2ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e6b37c-a85a-421c-9792-c885c3d1885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:26 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Volume 6e8279bb-b4ad-42b8-8e2d-d9562df493fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe', 'volume_size': 1} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:26 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 1073741824" returned: 0 in 0.732s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:26 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 Jul 30 16:46:26 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:26 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6" returned: 0 in 0.337s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.968s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502958604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d98e25e-be96-4e75-9469-d7ce1c82b17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:25Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Creating volume 5d98e25e-be96-4e75-9469-d7ce1c82b17f {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:26 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:26 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f 1073741824 Jul 30 16:46:26 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924d8c86-e6bf-4e9b-b830-fcd098768522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e513fec-49f9-4d73-a526-75a77ebf58dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:26 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Volume volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 (0f62a6b4-425c-4780-b6fc-dc34f69900b6): created successfully Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e513fec-49f9-4d73-a526-75a77ebf58dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (bd453efc-f3e2-44a9-820b-6cdfbeb83b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:26 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8a4feb70-771c-467e-a85f-4deb56ffd103 tempest-CreateVolumesFromImageTest-1692076401 None] Created volume successfully. Jul 30 16:46:27 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f 1073741824" returned: 0 in 0.576s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:27 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f Jul 30 16:46:27 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:27 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f" returned: 0 in 0.287s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.356s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-756772019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5929e8a-882e-48d0-aaf0-2c29ff659df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:25Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Creating volume c5929e8a-882e-48d0-aaf0-2c29ff659df4 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:27 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b063838-863b-463e-94cb-00bd513b3bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:27 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 1073741824 Jul 30 16:46:27 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9885c9-3db8-4baa-afbd-08b5cb777dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:27 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Volume volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f (5d98e25e-be96-4e75-9469-d7ce1c82b17f): created successfully Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9885c9-3db8-4baa-afbd-08b5cb777dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (dc6a8278-b348-4e52-988f-5796943dc508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Flow 'volume_create_manager' (97bbb3a2-7e91-42ba-83f1-d78dbaa46903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0371f02d-207f-40ba-9a09-160b02af7902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8f11fc0c-09c0-42f1-a630-4c285d18ca0f tempest-CreateVolumesFromImageTest-1692076401 None] Created volume successfully. Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0371f02d-207f-40ba-9a09-160b02af7902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fad309-1dc1-47cf-bb95-d9a7c0aad19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d76fc55d454d2ebc8fef3a273dd310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:28Z,use_quota=True,user_id='696bec06cfef4d4a8a2e55f9dec4c7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88ea4ec-b864-480a-9918-8a7d3aa40288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88ea4ec-b864-480a-9918-8a7d3aa40288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b3dcd7-f187-4817-904d-1df9b457b67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:27 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b3dcd7-f187-4817-904d-1df9b457b67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0fad309-1dc1-47cf-bb95-d9a7c0aad19d', 'volume_name': 'volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d', 'volume_size': 1, 'image_id': '47956f24-1404-4db5-aac9-266310d33c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47956f24-1404-4db5-aac9-266310d33c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5edf9a38e71e329b867cece753b4dec3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04d76fc55d454d2ebc8fef3a273dd310', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5feb7cf2aa69436c259825325bb8a7c3748a19c408e901a49185f3e731342afce99d225ca56643a7108713783fb9f5688371344f136772cdaf130a72a24d54db', 'id': '47956f24-1404-4db5-aac9-266310d33c32', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47956f24-1404-4db5-aac9-266310d33c32/file', 'properties': {}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c2b92a-4a23-4b48-a1b3-c5a5cbeb2ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c2b92a-4a23-4b48-a1b3-c5a5cbeb2ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91bb116-ea09-4d14-9cae-e6453f4675f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Volume e0fad309-1dc1-47cf-bb95-d9a7c0aad19d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d', 'volume_size': 1, 'image_id': '47956f24-1404-4db5-aac9-266310d33c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47956f24-1404-4db5-aac9-266310d33c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5edf9a38e71e329b867cece753b4dec3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04d76fc55d454d2ebc8fef3a273dd310', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5feb7cf2aa69436c259825325bb8a7c3748a19c408e901a49185f3e731342afce99d225ca56643a7108713783fb9f5688371344f136772cdaf130a72a24d54db', 'id': '47956f24-1404-4db5-aac9-266310d33c32', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47956f24-1404-4db5-aac9-266310d33c32/file', 'properties': {}}, 'image_service': } Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Trying to clone e0fad309-1dc1-47cf-bb95-d9a7c0aad19d from image 47956f24-1404-4db5-aac9-266310d33c32 at location (None, [{'url': 'file:///opt/stack/data/glance/images/47956f24-1404-4db5-aac9-266310d33c32', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:46:28 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 1073741824" returned: 0 in 0.571s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:46:28 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:46:28 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 Jul 30 16:46:28 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c1605c-7e13-4b25-a0bb-41de44938058]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:28 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD Jul 30 16:46:28 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:28 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4" returned: 0 in 0.282s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.702s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1324407959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb14f5a2-6907-48a6-acee-f0c907161713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:26Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Creating volume fb14f5a2-6907-48a6-acee-f0c907161713 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:28 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a37047-c404-4735-b51f-155f6dccfef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:28 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 1073741824 Jul 30 16:46:28 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48eab415-95fd-42a0-aa86-07a7cddf796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Volume volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 (c5929e8a-882e-48d0-aaf0-2c29ff659df4): created successfully Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48eab415-95fd-42a0-aa86-07a7cddf796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (41cf2925-5bea-492c-a54b-7c22c20bc0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:28 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c05717de-e3a1-4b80-a0c2-44ddd185ebff tempest-CreateVolumesFromImageTest-1692076401 None] Created volume successfully. Jul 30 16:46:28 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:28 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD Jul 30 16:46:28 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Temporary image 47956f24-1404-4db5-aac9-266310d33c32 is fetched for user 696bec06cfef4d4a8a2e55f9dec4c7cc. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:46:29 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 1073741824" returned: 0 in 0.570s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Flow 'volume_create_manager' (57e09ce2-0231-44ee-9fa0-a94801e19140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f9d1aa-410e-43df-823c-098b47d0b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f9d1aa-410e-43df-823c-098b47d0b94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f6e7ddf59545a19754a7a9a418fd5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:29Z,use_quota=True,user_id='84f3e0a677ff43efbc44c802ebb65572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd4eb8f9-bc53-467b-91de-31476bcfc374),volume_type_id=fd4eb8f9-bc53-467b-91de-31476bcfc374)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f456dc33-61c7-4086-ba15-17eb1b9936c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f456dc33-61c7-4086-ba15-17eb1b9936c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd530275-7e25-42f6-b1c3-b098cfebb45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.image.glance [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Creating Keystone auth plugin from conf {{(pid=88095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42ec59c-02ff-4432-ae23-77765e8044b8]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 Jul 30 16:46:29 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD Jul 30 16:46:29 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd530275-7e25-42f6-b1c3-b098cfebb45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71', 'volume_name': 'volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71', 'volume_size': 1, 'image_id': '986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2469fd38fc1079f6c32b68766966783d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12f6e7ddf59545a19754a7a9a418fd5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c92258b0ab979eeaa912095c801973c7afbf892f8961804ef54fc2f0ec19b7320007946bb7d7cd353362a28007c5ef6203298b4edfb1676a6b59880d4e7d69c', 'id': '986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f81718d-631e-40bc-9a0e-cdb02f8f7bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f81718d-631e-40bc-9a0e-cdb02f8f7bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b404b666-fd5b-4684-80d3-77296ee13a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:29 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Volume 5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71', 'volume_size': 1, 'image_id': '986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2469fd38fc1079f6c32b68766966783d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12f6e7ddf59545a19754a7a9a418fd5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c92258b0ab979eeaa912095c801973c7afbf892f8961804ef54fc2f0ec19b7320007946bb7d7cd353362a28007c5ef6203298b4edfb1676a6b59880d4e7d69c', 'id': '986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Trying to clone 5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 from image 986ce2ad-a4b3-4a66-b99f-07b46997d8ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'metadata': {}}]). {{(pid=88095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:46:29 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713" returned: 0 in 0.287s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2125720867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8279bb-b4ad-42b8-8e2d-d9562df493fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ebded04792d475c961a46c4f0546161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:26Z,use_quota=True,user_id='3d637a4bcf954eb897d2c3cf0b559e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Creating volume 6e8279bb-b4ad-42b8-8e2d-d9562df493fe {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:29 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81429427-804a-4b92-ad5a-822123ad45ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb14f5a2-6907-48a6-acee-f0c907161713', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:29 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe 1073741824 Jul 30 16:46:29 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb76241-b1d0-4e9c-91b6-2c3319b66402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:29 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Volume volume-fb14f5a2-6907-48a6-acee-f0c907161713 (fb14f5a2-6907-48a6-acee-f0c907161713): created successfully Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb76241-b1d0-4e9c-91b6-2c3319b66402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (8936c867-261e-4151-930f-88283c89614b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:29 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d55abc1e-2bb5-4c54-ad6c-95633c168b11 tempest-CreateVolumesFromImageTest-1692076401 None] Created volume successfully. Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:46:29 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e62640-77ed-4f52-a8ea-66e23f980239]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD Jul 30 16:46:29 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD Jul 30 16:46:29 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:30 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD" returned: 1 in 0.422s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:30 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe 1073741824" returned: 0 in 0.548s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe Jul 30 16:46:30 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:30 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD Jul 30 16:46:30 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:30 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe" returned: 0 in 0.238s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.965s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e6b37c-a85a-421c-9792-c885c3d1885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ff6ab9-045c-440c-b50b-8625e5885921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Creating offline snapshot aa4c664d-5196-4311-bc81-b6748dad3333 of volume 7be8282d-4d5b-4b03-a07d-9680bf714289 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:46:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Volume volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe (6e8279bb-b4ad-42b8-8e2d-d9562df493fe): created successfully Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ff6ab9-045c-440c-b50b-8625e5885921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Flow 'volume_create_manager' (2585a22f-6247-4f25-a731-d7cc0ef7de06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[14791776-8640-4fb8-9be7-2082f7bd3aeb]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5875ebc9-df99-455c-8b7a-fc3e765f4258 tempest-CreateVolumesFromImageTest-1692076401 None] Created volume successfully. Jul 30 16:46:30 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD" returned: 1 in 0.334s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Temporary image 986ce2ad-a4b3-4a66-b99f-07b46997d8ff is fetched for user 84f3e0a677ff43efbc44c802ebb65572. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[80789d6c-63fe-4c41-a4cd-2d0355d871bd]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 Jul 30 16:46:30 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-6e8279bb-b4ad-42b8-8e2d-d9562df493fe-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-6e8279bb-b4ad-42b8-8e2d-d9562df493fe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:30 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD Jul 30 16:46:30 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-quobyte-6e8279bb-b4ad-42b8-8e2d-d9562df493fe" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-6e8279bb-b4ad-42b8-8e2d-d9562df493fe" acquired by "delete_volume" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[35726fa4-9874-4a8c-90fa-d9dcf9c42b4b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289" returned: 0 in 0.447s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe Jul 30 16:46:30 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 1G Jul 30 16:46:30 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:31 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD Jul 30 16:46:31 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:31 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe" returned: 0 in 0.403s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:31 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe Jul 30 16:46:31 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:31 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:31 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 1G" returned: 0 in 0.442s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7be8282d-4d5b-4b03-a07d-9680bf714289 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:31 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7be8282d-4d5b-4b03-a07d-9680bf714289 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 Jul 30 16:46:31 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:31 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e8279bb-b4ad-42b8-8e2d-d9562df493fe" returned: 0 in 0.297s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-6e8279bb-b4ad-42b8-8e2d-d9562df493fe" released by "delete_volume" :: held 0.745s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Created reservations ['0faafa95-eea9-41d2-a374-23c61c9350f4', '941a1a47-07a6-4384-89f6-e2cf50e2c7cc', 'b218fae3-b961-4534-a031-07b166acb23e', '0778bb92-89c4-4b72-9aad-82722aa9dc66'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:31 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:31 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:31 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7be8282d-4d5b-4b03-a07d-9680bf714289 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333" returned: 0 in 0.306s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:31 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 is being set with open permissions: ugo+rw Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:31 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 Jul 30 16:46:31 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-fb14f5a2-6907-48a6-acee-f0c907161713-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-fb14f5a2-6907-48a6-acee-f0c907161713-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-quobyte-fb14f5a2-6907-48a6-acee-f0c907161713" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:31 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.327s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:31 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-fb14f5a2-6907-48a6-acee-f0c907161713" acquired by "delete_volume" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333" returned: 0 in 0.311s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:31 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Deleted volume successfully. Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5009fe1-94d0-4bbe-b798-cff758d40c21]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-712ec50f-5732-498d-9805-20746bd5e284 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-6e8279bb-b4ad-42b8-8e2d-d9562df493fe-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:32 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.info Jul 30 16:46:32 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:32 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 Jul 30 16:46:32 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:32 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.info" returned: 0 in 0.248s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:32 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.info is being set with open permissions: ugo+rw Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:32 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.info Jul 30 16:46:32 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:32 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713" returned: 0 in 0.366s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:32 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713 Jul 30 16:46:32 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:32 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.info" returned: 0 in 0.247s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.473s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fad309-1dc1-47cf-bb95-d9a7c0aad19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d76fc55d454d2ebc8fef3a273dd310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:28Z,use_quota=True,user_id='696bec06cfef4d4a8a2e55f9dec4c7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Creating volume e0fad309-1dc1-47cf-bb95-d9a7c0aad19d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:32 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:32 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d 1073741824 Jul 30 16:46:32 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:32 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fb14f5a2-6907-48a6-acee-f0c907161713" returned: 0 in 0.241s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-fb14f5a2-6907-48a6-acee-f0c907161713" released by "delete_volume" :: held 0.658s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8f6a587e-7997-40e2-830b-6ee2b73a449e tempest-CreateVolumesFromSnapshotTest-2080161545 None] Create snapshot completed successfully Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Created reservations ['d9d0b2d0-3281-4c7f-9a82-af4bd72a8362', '62529ce4-79fa-4c95-8f38-b5c6fb026240', '2c675862-78fa-4a96-8de6-6d3780018da8', '30083ed4-cff0-4838-b75a-c1898a3ee849'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:32 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:32 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:32 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.271s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:32 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Deleted volume successfully. Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c63b5904-f63d-418a-a895-bb186ae67b3b tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-fb14f5a2-6907-48a6-acee-f0c907161713-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:33 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d 1073741824" returned: 0 in 0.503s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-c5929e8a-882e-48d0-aaf0-2c29ff659df4-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-c5929e8a-882e-48d0-aaf0-2c29ff659df4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-quobyte-c5929e8a-882e-48d0-aaf0-2c29ff659df4" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:33 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d Jul 30 16:46:33 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-c5929e8a-882e-48d0-aaf0-2c29ff659df4" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7f7435-8149-4cce-b5a8-23aedfd67779]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:33 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 Jul 30 16:46:33 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:33 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d" returned: 0 in 0.252s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f6e7ddf59545a19754a7a9a418fd5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:29Z,use_quota=True,user_id='84f3e0a677ff43efbc44c802ebb65572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd4eb8f9-bc53-467b-91de-31476bcfc374),volume_type_id=fd4eb8f9-bc53-467b-91de-31476bcfc374)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Creating volume 5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:33 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:33 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 1073741824 Jul 30 16:46:33 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Attempting download of 47956f24-1404-4db5-aac9-266310d33c32 ((None, [{'url': 'file:///opt/stack/data/glance/images/47956f24-1404-4db5-aac9-266310d33c32', 'metadata': {}}])) to volume e0fad309-1dc1-47cf-bb95-d9a7c0aad19d. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[27097446-eb1b-4e61-aba2-95f4a4c5002c]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47956f24-1404-4db5-aac9-266310d33c32_sklbmu8b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:33 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4" returned: 0 in 0.381s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:33 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4 Jul 30 16:46:33 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:33 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47956f24-1404-4db5-aac9-266310d33c32_sklbmu8b Jul 30 16:46:33 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:33 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-c5929e8a-882e-48d0-aaf0-2c29ff659df4" returned: 0 in 0.263s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-c5929e8a-882e-48d0-aaf0-2c29ff659df4" released by "delete_volume" :: held 0.691s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:33 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:33 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47956f24-1404-4db5-aac9-266310d33c32_sklbmu8b" returned: 0 in 0.394s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47956f24-1404-4db5-aac9-266310d33c32_sklbmu8b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 1073741824" returned: 0 in 0.508s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:33 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 Jul 30 16:46:33 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:33 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Created reservations ['e93b7d7f-2184-4cb3-9cc8-99ff30decb90', '45129c54-eef9-40cd-a06c-a93a52ec6722', '7f9c2ac0-a5aa-4639-9318-cff4d307d71a', 'b1eda3f1-584a-43c3-882b-13b10e7cf69f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:33 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47956f24-1404-4db5-aac9-266310d33c32_sklbmu8b Jul 30 16:46:33 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:34 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:34 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-5d98e25e-be96-4e75-9469-d7ce1c82b17f-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-5d98e25e-be96-4e75-9469-d7ce1c82b17f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:34 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:34 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71" returned: 0 in 0.447s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47956f24-1404-4db5-aac9-266310d33c32_sklbmu8b" returned: 1 in 0.521s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47956f24-1404-4db5-aac9-266310d33c32_sklbmu8b' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (e32c423c-860b-4d7c-a59a-d5f400481594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83d5563-5bc6-404b-98c8-4ca7fe39aea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[06de9542-32bd-447e-a4aa-59a17d80f4ba]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-quobyte-5d98e25e-be96-4e75-9469-d7ce1c82b17f" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83d5563-5bc6-404b-98c8-4ca7fe39aea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132800622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac27c13e-0709-40ce-a41d-3561cd6d4e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:34Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c896416-92ba-4240-b048-f3c8d21b5bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c896416-92ba-4240-b048-f3c8d21b5bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7d2f87-fd29-4cc0-bc12-567073c148e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7d2f87-fd29-4cc0-bc12-567073c148e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac27c13e-0709-40ce-a41d-3561cd6d4e2e', 'volume_name': 'volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b442f133-f690-43c5-a539-a91f027961c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b442f133-f690-43c5-a539-a91f027961c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a63f082-ecaa-4637-8bb5-0dfda690b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:34 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume ac27c13e-0709-40ce-a41d-3561cd6d4e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e', 'volume_size': 1} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132800622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac27c13e-0709-40ce-a41d-3561cd6d4e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:34Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Creating volume ac27c13e-0709-40ce-a41d-3561cd6d4e2e {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:34 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:34 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.443s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-5d98e25e-be96-4e75-9469-d7ce1c82b17f" acquired by "delete_volume" :: waited 0.133s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:34 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e 1073741824 Jul 30 16:46:34 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Attempting download of 986ce2ad-a4b3-4a66-b99f-07b46997d8ff ((None, [{'url': 'file:///opt/stack/data/glance/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'metadata': {}}])) to volume 5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:46:34 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Deleted volume successfully. Jul 30 16:46:34 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD Jul 30 16:46:34 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5e6703d4-0d73-405f-8b3a-fc58b2c3415a tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-c5929e8a-882e-48d0-aaf0-2c29ff659df4-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7304d70-b233-4224-bc6e-c6b795d3bdd2]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e65e3a6-64ae-43d1-8b91-1f378d839a74]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_0iue7grj {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:34 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f Jul 30 16:46:34 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:34 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_0iue7grj Jul 30 16:46:34 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (2900f8e7-d2e5-4090-b232-740f9607f19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133d774e-cef0-4b04-8109-a9fafc3c6335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133d774e-cef0-4b04-8109-a9fafc3c6335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130524250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606d664f-604d-4a7e-9163-78300157a6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:35Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa002eee-8eed-4b44-b972-f40b6ea3b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa002eee-8eed-4b44-b972-f40b6ea3b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567f215a-1bd4-4539-b91c-3cbbccc98934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567f215a-1bd4-4539-b91c-3cbbccc98934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606d664f-604d-4a7e-9163-78300157a6c4', 'volume_name': 'volume-606d664f-604d-4a7e-9163-78300157a6c4', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:35 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86fa9c7f-87e4-45fa-9f0e-a85df402c6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86fa9c7f-87e4-45fa-9f0e-a85df402c6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0271c9a0-a954-4e72-9c1e-d39e02b55710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume 606d664f-604d-4a7e-9163-78300157a6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606d664f-604d-4a7e-9163-78300157a6c4', 'volume_size': 1} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f" returned: 0 in 0.436s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f Jul 30 16:46:35 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e 1073741824" returned: 0 in 0.752s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_0iue7grj" returned: 0 in 0.605s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_0iue7grj {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD Jul 30 16:46:35 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e Jul 30 16:46:35 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_0iue7grj Jul 30 16:46:35 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5d98e25e-be96-4e75-9469-d7ce1c82b17f" returned: 0 in 0.524s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-5d98e25e-be96-4e75-9469-d7ce1c82b17f" released by "delete_volume" :: held 1.076s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (80dc6cd0-4e53-4911-8358-1066f17de37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562ec313-c056-4733-8f5c-38b7b6a0415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562ec313-c056-4733-8f5c-38b7b6a0415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571968885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4196beb-990e-4193-816d-9d46c55a2cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:36Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:35 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89a9fc1-f925-4133-9a6e-8f63931b854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89a9fc1-f925-4133-9a6e-8f63931b854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:35 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7190f507-6c42-49f2-b1f4-f611306eedab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7190f507-6c42-49f2-b1f4-f611306eedab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4196beb-990e-4193-816d-9d46c55a2cd4', 'volume_name': 'volume-b4196beb-990e-4193-816d-9d46c55a2cd4', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d50534e-5371-4c7a-a843-ca3fe2c08c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d50534e-5371-4c7a-a843-ca3fe2c08c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:35 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e45f520-bf40-4c6f-a31f-7d517517c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume b4196beb-990e-4193-816d-9d46c55a2cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4196beb-990e-4193-816d-9d46c55a2cd4', 'volume_size': 1} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_0iue7grj" returned: 1 in 0.528s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_0iue7grj' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e" returned: 0 in 0.463s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD" returned: 1 in 0.707s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] 47956f24-1404-4db5-aac9-266310d33c32 was raw, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[47955934-3bd2-48a2-9e34-1c2ec936ce1c]: (4, 'raw') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130524250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606d664f-604d-4a7e-9163-78300157a6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:35Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Creating volume 606d664f-604d-4a7e-9163-78300157a6c4 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:35 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:35 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:35 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 1073741824 Jul 30 16:46:35 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a63f082-ecaa-4637-8bb5-0dfda690b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55007e0-5ff1-4cf5-9f1a-c985a003928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:35 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e (ac27c13e-0709-40ce-a41d-3561cd6d4e2e): created successfully Jul 30 16:46:35 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55007e0-5ff1-4cf5-9f1a-c985a003928a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (e32c423c-860b-4d7c-a59a-d5f400481594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Created reservations ['8065d603-4135-4e38-8167-21ffa1f10f50', 'eb82720d-dae5-44c3-8404-32c82ec67fb1', '8114f0ce-e8ff-42af-a807-0e7aaa353591', '95eeb46d-7de5-4016-b51a-30e6b1a2b971'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-48fabf78-eca2-4a8a-9ed7-a52979d1a412 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created volume successfully. Jul 30 16:46:36 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD Jul 30 16:46:36 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:36 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:36 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (7bdbacd9-e72a-4593-b9ac-4f9efb6bbd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb1dda8-0f8e-4a47-868f-c0a330e2dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb1dda8-0f8e-4a47-868f-c0a330e2dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2042205358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe85740c-6b25-430e-8274-df4d6bcea009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:36Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57234783-9439-49d2-bb78-707811999fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57234783-9439-49d2-bb78-707811999fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e61b23-e313-4024-9758-9d69dbf03745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e61b23-e313-4024-9758-9d69dbf03745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe85740c-6b25-430e-8274-df4d6bcea009', 'volume_name': 'volume-fe85740c-6b25-430e-8274-df4d6bcea009', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e38db1-34c5-4721-a21e-4ab990e6d2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e38db1-34c5-4721-a21e-4ab990e6d2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:36 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c3d3c0-92e4-4070-9c33-4b72c67c00bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:36 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume fe85740c-6b25-430e-8274-df4d6bcea009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe85740c-6b25-430e-8274-df4d6bcea009', 'volume_size': 1} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD" returned: 0 in 0.639s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:36 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d" returned: 0 in 0.834s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47956f24-1404-4db5-aac9-266310d33c32_ymc2rpp6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:46:36 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:36 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d 1G Jul 30 16:46:36 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:36 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.495s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Deleted volume successfully. Jul 30 16:46:36 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 1073741824" returned: 0 in 0.890s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-84f2d5db-370c-4227-95fb-a90c8e1f807e tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-5d98e25e-be96-4e75-9469-d7ce1c82b17f-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:36 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD Jul 30 16:46:36 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-0f62a6b4-425c-4780-b6fc-dc34f69900b6-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:36 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 Jul 30 16:46:36 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (3c9d5842-1ff5-466d-b92a-199db8a1ee3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474b3ef6-6ae5-4507-abe1-9066c94cebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-0f62a6b4-425c-4780-b6fc-dc34f69900b6-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:36 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474b3ef6-6ae5-4507-abe1-9066c94cebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1321954866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73dde90-e020-4c94-8357-2e1d297b8680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:37Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32431966-5661-44a2-8b24-21eb242da908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32431966-5661-44a2-8b24-21eb242da908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3e584f-d8df-438d-80d6-2ddd9490278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3e584f-d8df-438d-80d6-2ddd9490278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73dde90-e020-4c94-8357-2e1d297b8680', 'volume_name': 'volume-e73dde90-e020-4c94-8357-2e1d297b8680', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6fe40d-667f-4a34-926c-200936b76202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6fe40d-667f-4a34-926c-200936b76202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001f71f8-db98-4946-bca5-4fb9ae10968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume e73dde90-e020-4c94-8357-2e1d297b8680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73dde90-e020-4c94-8357-2e1d297b8680', 'volume_size': 1} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD" returned: 1 in 0.624s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD' failed. Not Retrying. {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] 986ce2ad-a4b3-4a66-b99f-07b46997d8ff was raw, converting to qcow2 {{(pid=88095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:37 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 Jul 30 16:46:37 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:37 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4" returned: 0 in 0.369s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571968885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4196beb-990e-4193-816d-9d46c55a2cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:36Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Creating volume b4196beb-990e-4193-816d-9d46c55a2cd4 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:37 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:37 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "cinder-quobyte-0f62a6b4-425c-4780-b6fc-dc34f69900b6" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d 1G" returned: 0 in 0.593s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Downloaded image 47956f24-1404-4db5-aac9-266310d33c32 ((None, [{'url': 'file:///opt/stack/data/glance/images/47956f24-1404-4db5-aac9-266310d33c32', 'metadata': {}}])) to volume e0fad309-1dc1-47cf-bb95-d9a7c0aad19d successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Temporary image 47956f24-1404-4db5-aac9-266310d33c32 for user 696bec06cfef4d4a8a2e55f9dec4c7cc is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Marking volume e0fad309-1dc1-47cf-bb95-d9a7c0aad19d as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:46:37 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 1073741824 Jul 30 16:46:37 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0271c9a0-a954-4e72-9c1e-d39e02b55710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606d664f-604d-4a7e-9163-78300157a6c4', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0eba494-d490-4af9-a674-450c1f0249cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-0f62a6b4-425c-4780-b6fc-dc34f69900b6" acquired by "delete_volume" :: waited 0.040s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Copying metadata from image 47956f24-1404-4db5-aac9-266310d33c32 to e0fad309-1dc1-47cf-bb95-d9a7c0aad19d. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Creating volume glance metadata for volume e0fad309-1dc1-47cf-bb95-d9a7c0aad19d backed by image 47956f24-1404-4db5-aac9-266310d33c32 with: {'image_id': '47956f24-1404-4db5-aac9-266310d33c32', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5edf9a38e71e329b867cece753b4dec3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:46:37 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume volume-606d664f-604d-4a7e-9163-78300157a6c4 (606d664f-604d-4a7e-9163-78300157a6c4): created successfully Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0eba494-d490-4af9-a674-450c1f0249cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (2900f8e7-d2e5-4090-b232-740f9607f19b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c504edc-0ffc-4b40-ab28-1b4ca7b31066]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-64cc2289-ab05-4800-bb41-bc4f48bf085a tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created volume successfully. Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91bb116-ea09-4d14-9cae-e6453f4675f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d', 'volume_size': 1, 'image_id': '47956f24-1404-4db5-aac9-266310d33c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47956f24-1404-4db5-aac9-266310d33c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5edf9a38e71e329b867cece753b4dec3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04d76fc55d454d2ebc8fef3a273dd310', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5feb7cf2aa69436c259825325bb8a7c3748a19c408e901a49185f3e731342afce99d225ca56643a7108713783fb9f5688371344f136772cdaf130a72a24d54db', 'id': '47956f24-1404-4db5-aac9-266310d33c32', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47956f24-1404-4db5-aac9-266310d33c32/file', 'properties': {}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630c9bea-0815-45ed-96b1-c144981eb82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Volume volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d (e0fad309-1dc1-47cf-bb95-d9a7c0aad19d): created successfully Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630c9bea-0815-45ed-96b1-c144981eb82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Flow 'volume_create_manager' (97bbb3a2-7e91-42ba-83f1-d78dbaa46903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-853d2a7a-061f-42dc-bccb-6460aaed2efe tempest-VolumeImageDependencyTests-375211145 None] Created volume successfully. Jul 30 16:46:37 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 Jul 30 16:46:37 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:37 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71" returned: 0 in 0.612s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_986ce2ad-a4b3-4a66-b99f-07b46997d8ff_rpymq6q_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:46:37 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:37 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 1G Jul 30 16:46:37 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:37 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 1073741824" returned: 0 in 0.575s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:37 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 Jul 30 16:46:37 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:37 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6" returned: 0 in 0.561s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:37 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6 Jul 30 16:46:37 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:38 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 1G" returned: 0 in 0.364s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Downloaded image 986ce2ad-a4b3-4a66-b99f-07b46997d8ff ((None, [{'url': 'file:///opt/stack/data/glance/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'metadata': {}}])) to volume 5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 successfully. {{(pid=88095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Temporary image 986ce2ad-a4b3-4a66-b99f-07b46997d8ff for user 84f3e0a677ff43efbc44c802ebb65572 is deleted. {{(pid=88095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.volume_utils [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Marking volume 5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 as bootable. {{(pid=88095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Copying metadata from image 986ce2ad-a4b3-4a66-b99f-07b46997d8ff to 5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71. {{(pid=88095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Creating volume glance metadata for volume 5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 backed by image 986ce2ad-a4b3-4a66-b99f-07b46997d8ff with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2469fd38fc1079f6c32b68766966783d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:46:38 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4" returned: 0 in 0.302s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.673s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2042205358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe85740c-6b25-430e-8274-df4d6bcea009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:36Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Creating volume fe85740c-6b25-430e-8274-df4d6bcea009 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:38 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:38 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0f62a6b4-425c-4780-b6fc-dc34f69900b6" returned: 0 in 0.310s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:38 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 1073741824 Jul 30 16:46:38 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e45f520-bf40-4c6f-a31f-7d517517c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4196beb-990e-4193-816d-9d46c55a2cd4', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b71702-9c1e-4ca5-a3a7-a03b0e114c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-quobyte-0f62a6b4-425c-4780-b6fc-dc34f69900b6" released by "delete_volume" :: held 0.962s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:38 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume volume-b4196beb-990e-4193-816d-9d46c55a2cd4 (b4196beb-990e-4193-816d-9d46c55a2cd4): created successfully Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b71702-9c1e-4ca5-a3a7-a03b0e114c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (80dc6cd0-4e53-4911-8358-1066f17de37d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bb047468-db0d-4e74-99e6-f2cb71f1c2f8 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created volume successfully. Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b404b666-fd5b-4684-80d3-77296ee13a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71', 'volume_size': 1, 'image_id': '986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2469fd38fc1079f6c32b68766966783d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '12f6e7ddf59545a19754a7a9a418fd5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c92258b0ab979eeaa912095c801973c7afbf892f8961804ef54fc2f0ec19b7320007946bb7d7cd353362a28007c5ef6203298b4edfb1676a6b59880d4e7d69c', 'id': '986ce2ad-a4b3-4a66-b99f-07b46997d8ff', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/986ce2ad-a4b3-4a66-b99f-07b46997d8ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af459ec5-456a-4b77-a113-0790101cd4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:38 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Volume volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 (5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71): created successfully Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af459ec5-456a-4b77-a113-0790101cd4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Flow 'volume_create_manager' (57e09ce2-0231-44ee-9fa0-a94801e19140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Created reservations ['ceff32e5-0b14-47d2-acb9-a00dcbc24bc1', '38da81d1-215d-4c3f-9b97-383535486fba', 'a38bae37-cb01-4e58-9260-37fd2aa94fa7', '62a6fbcd-2e9e-4cb4-b382-a8312a0c2943'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a6f3cce8-d598-4dff-9d3d-9b5ff2b45e36 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Created volume successfully. Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:38 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:38 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Acquiring lock "cinder-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Lock "cinder-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:38 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:38 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.325s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 1073741824" returned: 0 in 0.614s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Deleted volume successfully. Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Acquiring lock "cinder-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Acquiring lock "cinder-quobyte-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-31c24268-e982-4c9c-92b1-54e27ee5fbc8 tempest-CreateVolumesFromImageTest-1692076401 None] Lock "cinder-0f62a6b4-425c-4780-b6fc-dc34f69900b6-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Lock "cinder-quobyte-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d" acquired by "delete_volume" :: waited 0.043s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "cinder-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d12619f-82b3-41f9-8d67-1675e254d795]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:38 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 Jul 30 16:46:38 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Acquiring lock "cinder-quobyte-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "cinder-quobyte-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a5d6b-fa83-4b83-ab14-aec05e9f4c3f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:39 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d Jul 30 16:46:39 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:39 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 Jul 30 16:46:39 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:39 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009" returned: 0 in 0.360s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.169s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1321954866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73dde90-e020-4c94-8357-2e1d297b8680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0dabecffb5459782990c56c2b561f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:37Z,use_quota=True,user_id='bc98c9e44e52439990ac1764683bd4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Creating volume e73dde90-e020-4c94-8357-2e1d297b8680 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:39 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c3d3c0-92e4-4070-9c33-4b72c67c00bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe85740c-6b25-430e-8274-df4d6bcea009', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:39 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 1073741824 Jul 30 16:46:39 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb462ef-f2a0-434e-890b-28b8c646dc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:39 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume volume-fe85740c-6b25-430e-8274-df4d6bcea009 (fe85740c-6b25-430e-8274-df4d6bcea009): created successfully Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb462ef-f2a0-434e-890b-28b8c646dc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (7bdbacd9-e72a-4593-b9ac-4f9efb6bbd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-78769bda-961c-4777-94cc-09b91b90cbc3 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created volume successfully. Jul 30 16:46:39 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d" returned: 0 in 0.599s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:39 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d Jul 30 16:46:39 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:39 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71" returned: 0 in 0.572s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:39 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71 Jul 30 16:46:39 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:39 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d" returned: 0 in 0.318s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Lock "cinder-quobyte-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d" released by "delete_volume" :: held 0.998s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:39 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 1073741824" returned: 0 in 0.605s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:39 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71" returned: 0 in 0.327s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Created reservations ['192785e5-b11a-4ad7-8a0d-b72a55401dd9', '4c55d69d-ae0a-4c63-9ec9-2af841d20e15', 'da3c407f-66ee-4f92-8997-c0e0bddf2780', 'f7ea85c7-0bb8-45f9-b120-0e9422948fd6'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "cinder-quobyte-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71" released by "delete_volume" :: held 0.960s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:40 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 Jul 30 16:46:40 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Created reservations ['c50b9641-3ff9-4947-a5fd-cbdebb5f0051', '0bf27734-8d3e-4dac-a8e7-73d0d89f200e', '789a3762-c8c6-48f3-b040-4f6b4f880e1f', 'd8b91111-1d9d-476e-89a7-74ca863e362b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:40 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:40 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:40 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:40 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:40 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680" returned: 0 in 0.412s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001f71f8-db98-4946-bca5-4fb9ae10968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73dde90-e020-4c94-8357-2e1d297b8680', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5fb2f2-5205-4252-808f-e92f453736a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:40 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Volume volume-e73dde90-e020-4c94-8357-2e1d297b8680 (e73dde90-e020-4c94-8357-2e1d297b8680): created successfully Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5fb2f2-5205-4252-808f-e92f453736a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Flow 'volume_create_manager' (3c9d5842-1ff5-466d-b92a-199db8a1ee3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:40 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-43d4b0e3-e38f-4783-a2ea-4fa4ba558aea tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created volume successfully. Jul 30 16:46:40 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:40 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Deleted volume successfully. Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d2a6d4cb-b4a6-4f4b-a6a7-e6a11c4163ad tempest-VolumeImageDependencyTests-375211145 None] Lock "cinder-e0fad309-1dc1-47cf-bb95-d9a7c0aad19d-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:40 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.302s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:40 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Deleted volume successfully. Jul 30 16:46:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-32bd9341-ac37-4ab1-94fc-bafe43b19902 tempest-VolumeAndVolumeTypeFromImageTest-1234395024 None] Lock "cinder-5a0948f2-8c14-4cc2-80f8-ca0fdd29ac71-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-e73dde90-e020-4c94-8357-2e1d297b8680-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-e73dde90-e020-4c94-8357-2e1d297b8680-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-quobyte-e73dde90-e020-4c94-8357-2e1d297b8680" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-e73dde90-e020-4c94-8357-2e1d297b8680" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:41 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb24a04-dedf-487d-9dbc-1d72fb6161b2]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:41 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 Jul 30 16:46:41 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:42 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680" returned: 0 in 0.487s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:42 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680 Jul 30 16:46:42 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:42 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e73dde90-e020-4c94-8357-2e1d297b8680" returned: 0 in 0.277s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-e73dde90-e020-4c94-8357-2e1d297b8680" released by "delete_volume" :: held 0.812s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created reservations ['b85a5e78-48ab-4c39-b652-7c502fb73ac1', '5d01a39c-7c9e-41a5-83db-d022bdfbbc00', '2eed49d4-06ab-440c-9082-5ed5575ad6f2', '3a1a4831-955c-4fbc-8add-994892445037'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:42 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:42 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-fe85740c-6b25-430e-8274-df4d6bcea009-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-fe85740c-6b25-430e-8274-df4d6bcea009-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-quobyte-fe85740c-6b25-430e-8274-df4d6bcea009" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-fe85740c-6b25-430e-8274-df4d6bcea009" acquired by "delete_volume" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[964a5652-e807-44b7-aabe-ad7bb3eb1c02]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:43 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.433s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Deleted volume successfully. Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1c84ed64-7e76-4495-a786-9de2d4eb93f6 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-e73dde90-e020-4c94-8357-2e1d297b8680-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:43 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 Jul 30 16:46:43 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:43 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009" returned: 0 in 0.483s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:43 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009 Jul 30 16:46:43 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:43 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-fe85740c-6b25-430e-8274-df4d6bcea009" returned: 0 in 0.379s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-fe85740c-6b25-430e-8274-df4d6bcea009" released by "delete_volume" :: held 0.940s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (37e67d04-6d39-42ab-9799-36f2b69b4c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6580e39b-5afe-4758-af34-607b4c4212e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6580e39b-5afe-4758-af34-607b4c4212e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063122389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e52898-4eac-4c4f-8340-da302916d2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:44Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c466f4-0ab1-451b-b967-d3cdfe1a491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c466f4-0ab1-451b-b967-d3cdfe1a491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb1915d-194f-46bf-95de-5ac8c611057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb1915d-194f-46bf-95de-5ac8c611057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e52898-4eac-4c4f-8340-da302916d2eb', 'volume_name': 'volume-49e52898-4eac-4c4f-8340-da302916d2eb', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56df48af-37bc-481d-b729-e77112af79a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56df48af-37bc-481d-b729-e77112af79a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5975a4d6-7353-44cc-a8c5-1cb8e3cbecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:44 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume 49e52898-4eac-4c4f-8340-da302916d2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e52898-4eac-4c4f-8340-da302916d2eb', 'volume_size': 1} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063122389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e52898-4eac-4c4f-8340-da302916d2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:44Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Creating volume 49e52898-4eac-4c4f-8340-da302916d2eb {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:44 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created reservations ['f474e735-f72a-41b2-b4d8-f76d63b244f6', '7e2f1d39-cc7e-4f5b-a927-74f881f101f1', '95eb4f88-1c30-41fe-aced-aabba516f98b', '75a073ff-0859-4a9d-88e3-c649f944f661'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:44 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb 1073741824 Jul 30 16:46:44 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:44 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:44 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:44 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.365s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:44 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Deleted volume successfully. Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8078e6e5-e66d-4bcd-8c88-a4efe3bb5df5 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-fe85740c-6b25-430e-8274-df4d6bcea009-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:44 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb 1073741824" returned: 0 in 0.623s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:44 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb Jul 30 16:46:44 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:45 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb" returned: 0 in 0.314s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-b4196beb-990e-4193-816d-9d46c55a2cd4-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5975a4d6-7353-44cc-a8c5-1cb8e3cbecf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e52898-4eac-4c4f-8340-da302916d2eb', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61cc6fb-edfa-44bc-83dd-392096c487ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-b4196beb-990e-4193-816d-9d46c55a2cd4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:45 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume volume-49e52898-4eac-4c4f-8340-da302916d2eb (49e52898-4eac-4c4f-8340-da302916d2eb): created successfully Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61cc6fb-edfa-44bc-83dd-392096c487ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (37e67d04-6d39-42ab-9799-36f2b69b4c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:45 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-11008aec-7536-4515-9f46-3b8124fab563 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created volume successfully. Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-quobyte-b4196beb-990e-4193-816d-9d46c55a2cd4" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-b4196beb-990e-4193-816d-9d46c55a2cd4" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[defeee9b-faa6-4baf-9f31-2bd881d1828a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:45 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 Jul 30 16:46:45 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:45 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4" returned: 0 in 0.473s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:45 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4 Jul 30 16:46:45 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Flow 'volume_create_manager' (dc8624c4-891c-4ef2-a9fc-39bcb87b75ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05384c7-f905-4fb8-a72a-34f89729834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05384c7-f905-4fb8-a72a-34f89729834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e1907a-21e7-4562-856a-9be25dc60b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ef5472ec1d4a94aacb59a5c6667e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:46Z,use_quota=True,user_id='0041f96d837e474e91ac947a6ff30f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a93c69d-c008-48c5-ba14-dd5cc5d29cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a93c69d-c008-48c5-ba14-dd5cc5d29cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bcff0e-4309-48e5-9817-ee57685a4dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:45 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bcff0e-4309-48e5-9817-ee57685a4dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e1907a-21e7-4562-856a-9be25dc60b14', 'volume_name': 'volume-03e1907a-21e7-4562-856a-9be25dc60b14', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e813b29b-805d-4113-a60b-e72ee88fe43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e813b29b-805d-4113-a60b-e72ee88fe43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47f4ed1-dba3-4025-8bbe-f286c65c4cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Volume 03e1907a-21e7-4562-856a-9be25dc60b14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e1907a-21e7-4562-856a-9be25dc60b14', 'volume_size': 1} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e1907a-21e7-4562-856a-9be25dc60b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ef5472ec1d4a94aacb59a5c6667e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:46Z,use_quota=True,user_id='0041f96d837e474e91ac947a6ff30f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Creating volume 03e1907a-21e7-4562-856a-9be25dc60b14 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:46 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 1073741824 Jul 30 16:46:46 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b4196beb-990e-4193-816d-9d46c55a2cd4" returned: 0 in 0.337s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-b4196beb-990e-4193-816d-9d46c55a2cd4" released by "delete_volume" :: held 0.879s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created reservations ['1c18607f-db0f-40bc-b8ba-005bc7859704', 'be0f1f68-c9e8-498e-9479-1c6919f443ca', 'a36134a9-e3c7-4090-b148-c1b4d7fd9129', '38bae084-49e4-441b-8c92-5b22cb3dd830'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:46 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 1073741824" returned: 0 in 0.581s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.347s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Deleted volume successfully. Jul 30 16:46:46 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 Jul 30 16:46:46 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d6fcea1d-c8ec-45dd-abaf-c06a5695f962 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-b4196beb-990e-4193-816d-9d46c55a2cd4-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (5305a9a3-f841-4f45-ad3a-09d1d0fc8446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d96ff6-4f9d-4158-beeb-0e0d91349810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d96ff6-4f9d-4158-beeb-0e0d91349810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2011960112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f921b35-1dda-4802-844c-c6dfdeaddf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:47Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0aeb9ee-3b0f-47b7-8159-898e0cda9afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0aeb9ee-3b0f-47b7-8159-898e0cda9afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f598ae15-e211-40e5-a649-fb11d61cad1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f598ae15-e211-40e5-a649-fb11d61cad1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f921b35-1dda-4802-844c-c6dfdeaddf3b', 'volume_name': 'volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7192fe5e-9606-4a7c-8ff4-0990a5224383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7192fe5e-9606-4a7c-8ff4-0990a5224383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffe6f5c-ba9b-4718-b6fb-2f89aa03c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume 4f921b35-1dda-4802-844c-c6dfdeaddf3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b', 'volume_size': 1} Jul 30 16:46:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:47 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14" returned: 0 in 0.352s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2011960112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f921b35-1dda-4802-844c-c6dfdeaddf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:47Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Creating volume 4f921b35-1dda-4802-844c-c6dfdeaddf3b {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:47 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:47 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b 1073741824 Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47f4ed1-dba3-4025-8bbe-f286c65c4cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e1907a-21e7-4562-856a-9be25dc60b14', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e76726c-36d2-40e9-9305-874204bb2bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Volume volume-03e1907a-21e7-4562-856a-9be25dc60b14 (03e1907a-21e7-4562-856a-9be25dc60b14): created successfully Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e76726c-36d2-40e9-9305-874204bb2bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Flow 'volume_create_manager' (dc8624c4-891c-4ef2-a9fc-39bcb87b75ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (06a2b4c2-6303-48d8-8757-398c9ea6e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bad5f1-7420-4d59-8278-ad2165f604bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bad5f1-7420-4d59-8278-ad2165f604bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164975308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ee8118-6238-4b13-8932-95700fcebb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:47Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2907e01-debe-4280-839f-5cc8849ad8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2907e01-debe-4280-839f-5cc8849ad8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a70c469-dc92-4bfc-abc5-8d764a994e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a70c469-dc92-4bfc-abc5-8d764a994e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ee8118-6238-4b13-8932-95700fcebb72', 'volume_name': 'volume-07ee8118-6238-4b13-8932-95700fcebb72', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a83a2d-33cd-4705-ab5f-8c33319f7ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a83a2d-33cd-4705-ab5f-8c33319f7ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dba6c17-eaa7-40d8-b8b2-9f5db92540ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume 07ee8118-6238-4b13-8932-95700fcebb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ee8118-6238-4b13-8932-95700fcebb72', 'volume_size': 1} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:47 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8ec154d3-0a61-4d16-a7e3-1d222932da4a tempest-CinderUnicodeTest-1555420935 None] Created volume successfully. Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:47 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:47 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-606d664f-604d-4a7e-9163-78300157a6c4-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-606d664f-604d-4a7e-9163-78300157a6c4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-quobyte-606d664f-604d-4a7e-9163-78300157a6c4" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-606d664f-604d-4a7e-9163-78300157a6c4" acquired by "delete_volume" :: waited 0.057s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:47 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.328s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:47 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b 1073741824" returned: 0 in 0.678s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (2eefe595-6514-4fa2-be57-f3898a402bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c381b1c-53c8-4a19-8c14-015ac163de85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb375e1-eb0d-40d3-98d5-6eca1607302c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c381b1c-53c8-4a19-8c14-015ac163de85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259195545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bf49eb-b12e-48b8-a93f-d312bfe5cf97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:48Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eac9fe3-951f-49b1-9395-9b0a15b1bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eac9fe3-951f-49b1-9395-9b0a15b1bd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2ae3b3-e063-4a46-a69f-0c2f58e34c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2ae3b3-e063-4a46-a69f-0c2f58e34c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39bf49eb-b12e-48b8-a93f-d312bfe5cf97', 'volume_name': 'volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a654df5-cdf3-4de5-8153-dbba4f25f807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a654df5-cdf3-4de5-8153-dbba4f25f807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11116979-28ca-4bea-a0cc-79e4de6409fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume 39bf49eb-b12e-48b8-a93f-d312bfe5cf97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97', 'volume_size': 1} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:47 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b Jul 30 16:46:47 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:47 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 Jul 30 16:46:47 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:48 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (22cd6755-539c-413b-9e5f-4e7285856a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bedffb5-7049-4216-bea9-6937c2e3bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b" returned: 0 in 0.396s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164975308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ee8118-6238-4b13-8932-95700fcebb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:47Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Creating volume 07ee8118-6238-4b13-8932-95700fcebb72 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:48 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:48 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bedffb5-7049-4216-bea9-6937c2e3bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1501568373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5188cade-e690-49ef-aaec-9f7db72a88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:48Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc777b1-aad3-434c-beee-19ea97edd205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 1073741824 Jul 30 16:46:48 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc777b1-aad3-434c-beee-19ea97edd205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad52d52-b297-4341-8fed-57f8c2e0c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad52d52-b297-4341-8fed-57f8c2e0c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5188cade-e690-49ef-aaec-9f7db72a88a8', 'volume_name': 'volume-5188cade-e690-49ef-aaec-9f7db72a88a8', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd716c8-d815-4204-9063-562bf3edc6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd716c8-d815-4204-9063-562bf3edc6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e28b35e-e01e-4326-b376-910011fe13a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume 5188cade-e690-49ef-aaec-9f7db72a88a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5188cade-e690-49ef-aaec-9f7db72a88a8', 'volume_size': 1} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4" returned: 0 in 0.576s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffe6f5c-ba9b-4718-b6fb-2f89aa03c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9182fd3a-04c1-462a-9cb4-c21c34e8a64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4 Jul 30 16:46:48 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:48 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b (4f921b35-1dda-4802-844c-c6dfdeaddf3b): created successfully Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9182fd3a-04c1-462a-9cb4-c21c34e8a64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (5305a9a3-f841-4f45-ad3a-09d1d0fc8446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-222a9b3d-f284-4c76-b4af-266c6148a814 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created volume successfully. Jul 30 16:46:48 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-606d664f-604d-4a7e-9163-78300157a6c4" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-606d664f-604d-4a7e-9163-78300157a6c4" released by "delete_volume" :: held 1.043s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created reservations ['9777d656-444c-4ecf-801e-4a4aecd089db', '6d799a46-ad62-4711-a6d2-98a66fa9d7c4', '0f77ae5f-b07f-4ffe-933b-533a2e3b2a30', 'f34895e9-fa03-4a56-a0a7-d6ed963ec0f1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:48 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:48 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:49 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 1073741824" returned: 0 in 0.730s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (469c8b09-2963-43d6-bbf9-a3206c2f41b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559c5663-5d26-4cbd-9c78-c21a94e5f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559c5663-5d26-4cbd-9c78-c21a94e5f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1943434119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e140664-0f90-4574-bbc9-4e4930db97b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:49Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c3e0be-bb19-4704-a021-469be9a04f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c3e0be-bb19-4704-a021-469be9a04f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5889f20e-0d0c-4cca-bc35-928b5470a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5889f20e-0d0c-4cca-bc35-928b5470a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e140664-0f90-4574-bbc9-4e4930db97b7', 'volume_name': 'volume-6e140664-0f90-4574-bbc9-4e4930db97b7', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f1f133-14a6-4893-915e-6bacd2774fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f1f133-14a6-4893-915e-6bacd2774fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c79300-8b73-482c-b463-e6b6bfd5d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Volume 6e140664-0f90-4574-bbc9-4e4930db97b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e140664-0f90-4574-bbc9-4e4930db97b7', 'volume_size': 1} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:49 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 Jul 30 16:46:49 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:49 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.297s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Deleted volume successfully. Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5689dae7-8099-4e8e-8d7a-dc7d918f85dc tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-606d664f-604d-4a7e-9163-78300157a6c4-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (ab86483c-6113-4197-800c-d125569ba1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c98908-bf1d-47fc-9481-b884a8dd789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c98908-bf1d-47fc-9481-b884a8dd789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1807840858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7264158-adca-4a4f-b5cc-8b3c96de614f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:49Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3404836d-a019-4f1e-9ad1-425688e0b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3404836d-a019-4f1e-9ad1-425688e0b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3270bb85-5759-49dc-9049-73a19a7a5b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3270bb85-5759-49dc-9049-73a19a7a5b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7264158-adca-4a4f-b5cc-8b3c96de614f', 'volume_name': 'volume-e7264158-adca-4a4f-b5cc-8b3c96de614f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171c0276-9c17-4685-b3d2-52db0c5e73c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171c0276-9c17-4685-b3d2-52db0c5e73c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f14ef59-93a8-405d-a34d-14b485c8028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume e7264158-adca-4a4f-b5cc-8b3c96de614f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7264158-adca-4a4f-b5cc-8b3c96de614f', 'volume_size': 1} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:49 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Flow 'volume_create_manager' (f7df2f1c-2a07-4949-9229-6ac7276b5c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a684c374-7df5-47c7-8a74-116ab026f77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72" returned: 0 in 0.268s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259195545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bf49eb-b12e-48b8-a93f-d312bfe5cf97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:48Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Creating volume 39bf49eb-b12e-48b8-a93f-d312bfe5cf97 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:49 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a684c374-7df5-47c7-8a74-116ab026f77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2027056190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6181af-2518-4cea-80cb-d2d4da43c42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ef5472ec1d4a94aacb59a5c6667e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:49Z,use_quota=True,user_id='0041f96d837e474e91ac947a6ff30f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 1073741824 Jul 30 16:46:49 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89243792-b690-4ddc-97a3-1a9f9c5cea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89243792-b690-4ddc-97a3-1a9f9c5cea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6197b3-5670-46d2-b36f-126e763854da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6197b3-5670-46d2-b36f-126e763854da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6181af-2518-4cea-80cb-d2d4da43c42d', 'volume_name': 'volume-db6181af-2518-4cea-80cb-d2d4da43c42d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44336316-4443-4d34-9a47-a75a8de5e84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44336316-4443-4d34-9a47-a75a8de5e84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea3ab51-5050-4dfb-ba26-f4dca21d3d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Volume db6181af-2518-4cea-80cb-d2d4da43c42d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6181af-2518-4cea-80cb-d2d4da43c42d', 'volume_size': 1} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dba6c17-eaa7-40d8-b8b2-9f5db92540ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ee8118-6238-4b13-8932-95700fcebb72', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb3b5c6-e648-4796-9feb-68c1c743f5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:49 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume volume-07ee8118-6238-4b13-8932-95700fcebb72 (07ee8118-6238-4b13-8932-95700fcebb72): created successfully Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb3b5c6-e648-4796-9feb-68c1c743f5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (06a2b4c2-6303-48d8-8757-398c9ea6e47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9e2a09dc-fc74-4575-b869-6d31e45c812f tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created volume successfully. Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-ac27c13e-0709-40ce-a41d-3561cd6d4e2e-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-ac27c13e-0709-40ce-a41d-3561cd6d4e2e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-quobyte-ac27c13e-0709-40ce-a41d-3561cd6d4e2e" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-ac27c13e-0709-40ce-a41d-3561cd6d4e2e" acquired by "delete_volume" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:49 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 1073741824" returned: 0 in 0.501s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b29f03-524e-49cd-8762-996239295ad9]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:50 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 Jul 30 16:46:50 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:50 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e Jul 30 16:46:50 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:50 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97" returned: 0 in 0.246s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1501568373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5188cade-e690-49ef-aaec-9f7db72a88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:48Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Creating volume 5188cade-e690-49ef-aaec-9f7db72a88a8 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:50 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11116979-28ca-4bea-a0cc-79e4de6409fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:50 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 1073741824 Jul 30 16:46:50 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8aea0c-d2b5-485e-89a3-7564a43a7b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:50 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 (39bf49eb-b12e-48b8-a93f-d312bfe5cf97): created successfully Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8aea0c-d2b5-485e-89a3-7564a43a7b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (2eefe595-6514-4fa2-be57-f3898a402bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0749e2c0-6d63-4124-837d-9dbb56a73e6d tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created volume successfully. Jul 30 16:46:50 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e" returned: 0 in 0.386s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:50 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e Jul 30 16:46:50 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:50 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-ac27c13e-0709-40ce-a41d-3561cd6d4e2e" returned: 0 in 0.239s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-ac27c13e-0709-40ce-a41d-3561cd6d4e2e" released by "delete_volume" :: held 0.670s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:50 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 1073741824" returned: 0 in 0.416s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created reservations ['80cd41c1-8757-450a-a9a0-ac63d755ebcc', '63c91973-6b95-4cf3-85a2-ae939f481968', '5c49d741-86db-4ca2-bfa8-420071279bfb', '02493b30-79c9-40d5-8cc6-7cb977149b95'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:50 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 Jul 30 16:46:50 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:50 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:50 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:51 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8" returned: 0 in 0.281s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1943434119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e140664-0f90-4574-bbc9-4e4930db97b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:49Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Creating volume 6e140664-0f90-4574-bbc9-4e4930db97b7 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:51 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-aa4c664d-5196-4311-bc81-b6748dad3333-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:51 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 1073741824 Jul 30 16:46:51 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e28b35e-e01e-4326-b376-910011fe13a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5188cade-e690-49ef-aaec-9f7db72a88a8', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207ef0f3-76c8-4111-9bb2-7ba5dd910a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-aa4c664d-5196-4311-bc81-b6748dad3333-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-quobyte-7be8282d-4d5b-4b03-a07d-9680bf714289" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume volume-5188cade-e690-49ef-aaec-9f7db72a88a8 (5188cade-e690-49ef-aaec-9f7db72a88a8): created successfully Jul 30 16:46:51 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207ef0f3-76c8-4111-9bb2-7ba5dd910a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (22cd6755-539c-413b-9e5f-4e7285856a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.313s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-7be8282d-4d5b-4b03-a07d-9680bf714289" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-quobyte-aa4c664d-5196-4311-bc81-b6748dad3333" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bf37315c-f0e0-4e66-a24f-b7a696bb3e9c tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created volume successfully. Jul 30 16:46:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Deleted volume successfully. Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-aa4c664d-5196-4311-bc81-b6748dad3333" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Deleting offline snapshot aa4c664d-5196-4311-bc81-b6748dad3333 of volume 7be8282d-4d5b-4b03-a07d-9680bf714289 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] snapshot_file for this snap is: volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-94c92acf-086c-47bf-9de2-5b90626707c0 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-ac27c13e-0709-40ce-a41d-3561cd6d4e2e-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c457d66d-1a77-41c8-abc0-05834dd1e5af]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:51 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 Jul 30 16:46:51 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:51 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 1073741824" returned: 0 in 0.466s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:51 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 Jul 30 16:46:51 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:51 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333" returned: 0 in 0.380s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7be8282d-4d5b-4b03-a07d-9680bf714289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71238b5-0f49-4ac8-9941-b65657a12af5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:51 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 Jul 30 16:46:51 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:51 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7" returned: 0 in 0.245s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.394s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1807840858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7264158-adca-4a4f-b5cc-8b3c96de614f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c065361dd47d4e849a0708b8e08f4af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:49Z,use_quota=True,user_id='f8ab1d43477c40ed81e26f5c79a28be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Creating volume e7264158-adca-4a4f-b5cc-8b3c96de614f {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:51 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c79300-8b73-482c-b463-e6b6bfd5d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e140664-0f90-4574-bbc9-4e4930db97b7', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:51 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f 1073741824 Jul 30 16:46:51 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9a0344-e56f-4623-b0ef-6894992fb6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Volume volume-6e140664-0f90-4574-bbc9-4e4930db97b7 (6e140664-0f90-4574-bbc9-4e4930db97b7): created successfully Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9a0344-e56f-4623-b0ef-6894992fb6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (469c8b09-2963-43d6-bbf9-a3206c2f41b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:51 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c459ec30-ffa2-4a16-ae8a-63de9618b4a8 tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:46:52 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289" returned: 0 in 0.380s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:52 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 Jul 30 16:46:52 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:52 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f 1073741824" returned: 0 in 0.490s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:52 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f Jul 30 16:46:52 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:52 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333" returned: 0 in 0.356s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:52 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333 Jul 30 16:46:52 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:52 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f" returned: 0 in 0.246s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.063s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2027056190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6181af-2518-4cea-80cb-d2d4da43c42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ef5472ec1d4a94aacb59a5c6667e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:49Z,use_quota=True,user_id='0041f96d837e474e91ac947a6ff30f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Creating volume db6181af-2518-4cea-80cb-d2d4da43c42d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:52 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:52 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d 1073741824 Jul 30 16:46:52 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f14ef59-93a8-405d-a34d-14b485c8028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7264158-adca-4a4f-b5cc-8b3c96de614f', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15722f9c-01e0-4bdf-9638-cf76321275cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:52 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289.aa4c664d-5196-4311-bc81-b6748dad3333" returned: 0 in 0.263s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:52 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Volume volume-e7264158-adca-4a4f-b5cc-8b3c96de614f (e7264158-adca-4a4f-b5cc-8b3c96de614f): created successfully Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15722f9c-01e0-4bdf-9638-cf76321275cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Flow 'volume_create_manager' (ab86483c-6113-4197-800c-d125569ba1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-aa4c664d-5196-4311-bc81-b6748dad3333" released by "_delete_snapshot" :: held 1.508s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cd9d3f8c-423c-4998-8e56-e6f069e6e418 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created volume successfully. Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-7be8282d-4d5b-4b03-a07d-9680bf714289" released by "delete_snapshot" :: held 1.557s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created reservations ['63f2670b-e45d-4798-858a-d2f51b65c614', '6330248e-db2d-45c4-b77a-25bc5fda3007', '915a7096-4ce9-4c07-a805-e97905f89cb1', 'bb2d013a-9dd2-4dc1-a567-9ee41b5f8774'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Delete snapshot completed successfully. Jul 30 16:46:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd3756e0-9d6b-42cf-9706-78c29bff32f1 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-aa4c664d-5196-4311-bc81-b6748dad3333-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:53 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d 1073741824" returned: 0 in 0.475s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:53 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d Jul 30 16:46:53 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-7be8282d-4d5b-4b03-a07d-9680bf714289-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-7be8282d-4d5b-4b03-a07d-9680bf714289-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "cinder-quobyte-7be8282d-4d5b-4b03-a07d-9680bf714289" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-7be8282d-4d5b-4b03-a07d-9680bf714289" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-e7264158-adca-4a4f-b5cc-8b3c96de614f-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee02ef-8d8d-4667-af24-1d89c35be72c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-e7264158-adca-4a4f-b5cc-8b3c96de614f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:53 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d" returned: 0 in 0.360s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.154s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea3ab51-5050-4dfb-ba26-f4dca21d3d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6181af-2518-4cea-80cb-d2d4da43c42d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9da7420-a6e3-4d3b-a157-dff72523f365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Creating offline snapshot a9ba4959-cdb2-4214-918c-2d3bccbd1f08 of volume 6e140664-0f90-4574-bbc9-4e4930db97b7 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:46:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Volume volume-db6181af-2518-4cea-80cb-d2d4da43c42d (db6181af-2518-4cea-80cb-d2d4da43c42d): created successfully Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9da7420-a6e3-4d3b-a157-dff72523f365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Flow 'volume_create_manager' (f7df2f1c-2a07-4949-9229-6ac7276b5c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fac5eb-411e-4df1-a83a-c659ca14e87c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:53 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 Jul 30 16:46:53 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-quobyte-e7264158-adca-4a4f-b5cc-8b3c96de614f" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:53 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a2c495c1-f146-4813-9090-41230c4ecf63 tempest-CinderUnicodeTest-1555420935 None] Created volume successfully. Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-e7264158-adca-4a4f-b5cc-8b3c96de614f" acquired by "delete_volume" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ee74ef-2a1a-4996-9da4-4ae282bc02bb]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:53 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 Jul 30 16:46:53 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:53 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f Jul 30 16:46:53 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:53 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289" returned: 0 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:53 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289 Jul 30 16:46:53 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:53 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:53 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 1G Jul 30 16:46:53 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f" returned: 0 in 0.411s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f Jul 30 16:46:54 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-7be8282d-4d5b-4b03-a07d-9680bf714289" returned: 0 in 0.275s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-quobyte-7be8282d-4d5b-4b03-a07d-9680bf714289" released by "delete_volume" :: held 0.745s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Created reservations ['d2265015-6ec9-4a59-bfd1-8f4a62dd2985', '5e73866b-4ece-4301-886e-c914871e5d06', '1ac98871-44cf-4a81-97d3-8572494a3699', 'c661b65d-8b41-40bb-93f0-750fdf6e35d4'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:54 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-e7264158-adca-4a4f-b5cc-8b3c96de614f" returned: 0 in 0.281s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-e7264158-adca-4a4f-b5cc-8b3c96de614f" released by "delete_volume" :: held 0.738s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created reservations ['1f63f6aa-a9db-4073-a1d2-8f3b9d3b7143', '23988141-d6a6-4485-a6ca-623f5ebb9fa8', '1fbf81dd-03c0-41a7-bfed-cb31810f5219', '46dab2e2-2e00-414c-bb1b-a5cff38170ea'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:54 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 1G" returned: 0 in 0.515s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e140664-0f90-4574-bbc9-4e4930db97b7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:54 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e140664-0f90-4574-bbc9-4e4930db97b7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:54 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:54 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.351s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Deleted volume successfully. Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-5188cade-e690-49ef-aaec-9f7db72a88a8-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7c85f2a7-fb0b-4e27-b2a0-95cc78448844 tempest-CreateVolumesFromSnapshotTest-2080161545 None] Lock "cinder-7be8282d-4d5b-4b03-a07d-9680bf714289-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-5188cade-e690-49ef-aaec-9f7db72a88a8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-quobyte-5188cade-e690-49ef-aaec-9f7db72a88a8" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-5188cade-e690-49ef-aaec-9f7db72a88a8" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db7eb63-aba3-49a2-bec8-030be7e02059]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.335s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Deleted volume successfully. Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6c9959ef-94f2-4273-9a3d-46bbc6cc2cfc tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-e7264158-adca-4a4f-b5cc-8b3c96de614f-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:54 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 Jul 30 16:46:54 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e140664-0f90-4574-bbc9-4e4930db97b7 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08" returned: 0 in 0.558s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 is being set with open permissions: ugo+rw Jul 30 16:46:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 Jul 30 16:46:55 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:55 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08" returned: 0 in 0.266s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.info Jul 30 16:46:55 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8" returned: 0 in 0.562s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8 Jul 30 16:46:55 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.info" returned: 0 in 0.300s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.info is being set with open permissions: ugo+rw Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.info Jul 30 16:46:55 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5188cade-e690-49ef-aaec-9f7db72a88a8" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-5188cade-e690-49ef-aaec-9f7db72a88a8" released by "delete_volume" :: held 0.904s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created reservations ['ca03ccde-5da4-4c64-a8af-37ab0860a35c', '651ac25e-68f9-4ba0-8aa1-a4a22bbccc1f', 'ce22ef0f-6556-4855-9623-413d90fbab20', '425fa26d-ae96-43c2-a392-0474b2441719'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:55 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-39bf49eb-b12e-48b8-a93f-d312bfe5cf97-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-39bf49eb-b12e-48b8-a93f-d312bfe5cf97-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-quobyte-39bf49eb-b12e-48b8-a93f-d312bfe5cf97" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:55 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.info" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.892s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-39bf49eb-b12e-48b8-a93f-d312bfe5cf97" acquired by "delete_volume" :: waited 0.064s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Creating offline snapshot b5a37db0-c18e-4f01-95ec-9fadc7978cdd of volume db6181af-2518-4cea-80cb-d2d4da43c42d {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:46:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0af83b66-4667-4f76-bb88-5251f6195020 tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3b3eb2-6fe4-41a8-b728-8e4252f04412]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a380116-0e76-4684-9922-7e01fb8d18bd]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.353s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Deleted volume successfully. Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d0bc2cde-37e6-4aa7-beba-e8d2805849e1 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-5188cade-e690-49ef-aaec-9f7db72a88a8-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:56 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 Jul 30 16:46:56 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:56 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d Jul 30 16:46:56 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-a9ba4959-cdb2-4214-918c-2d3bccbd1f08-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Lock "cinder-a9ba4959-cdb2-4214-918c-2d3bccbd1f08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-6e140664-0f90-4574-bbc9-4e4930db97b7" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6e140664-0f90-4574-bbc9-4e4930db97b7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-a9ba4959-cdb2-4214-918c-2d3bccbd1f08" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-a9ba4959-cdb2-4214-918c-2d3bccbd1f08" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot a9ba4959-cdb2-4214-918c-2d3bccbd1f08 of volume 6e140664-0f90-4574-bbc9-4e4930db97b7 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:46:56 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97" returned: 0 in 0.547s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7bfda9-42f7-4168-9ce1-4f11189fedc0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97 Jul 30 16:46:56 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:56 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d" returned: 0 in 0.609s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd 1G Jul 30 16:46:56 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:56 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 Jul 30 16:46:56 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-39bf49eb-b12e-48b8-a93f-d312bfe5cf97" returned: 0 in 0.405s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-39bf49eb-b12e-48b8-a93f-d312bfe5cf97" released by "delete_volume" :: held 1.018s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created reservations ['d781716e-51a2-4718-8ad6-6cc71bba07ea', 'ce6e4a14-5509-4743-9c3d-cba03e175d7f', 'ae36b153-1e75-4ab9-b258-4703607c3d5f', '1e613f35-bd6c-4140-90d6-a8f38396c6f1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:57 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08" returned: 0 in 0.535s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e140664-0f90-4574-bbc9-4e4930db97b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a77aa92-3d2f-4358-90a3-03702dbd13c6]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd 1G" returned: 0 in 0.608s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6181af-2518-4cea-80cb-d2d4da43c42d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:57 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6181af-2518-4cea-80cb-d2d4da43c42d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd Jul 30 16:46:57 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 Jul 30 16:46:57 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.293s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:57 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Deleted volume successfully. Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e68e6bcf-4725-427e-90c6-308c038d43dd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-39bf49eb-b12e-48b8-a93f-d312bfe5cf97-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:57 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db6181af-2518-4cea-80cb-d2d4da43c42d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd" returned: 0 in 0.387s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd is being set with open permissions: ugo+rw Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7" returned: 0 in 0.507s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd Jul 30 16:46:57 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 Jul 30 16:46:57 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd" returned: 0 in 0.321s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.info Jul 30 16:46:58 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08" returned: 0 in 0.372s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08 Jul 30 16:46:58 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-07ee8118-6238-4b13-8932-95700fcebb72-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-07ee8118-6238-4b13-8932-95700fcebb72-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-quobyte-07ee8118-6238-4b13-8932-95700fcebb72" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-07ee8118-6238-4b13-8932-95700fcebb72" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:58 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.info" returned: 0 in 0.375s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.info is being set with open permissions: ugo+rw Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c23f865-6152-40e2-96c6-c885691e3978]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.info Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7.a9ba4959-cdb2-4214-918c-2d3bccbd1f08" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-a9ba4959-cdb2-4214-918c-2d3bccbd1f08" released by "_delete_snapshot" :: held 1.987s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6e140664-0f90-4574-bbc9-4e4930db97b7" released by "delete_snapshot" :: held 2.030s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:58 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 Jul 30 16:46:58 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Created reservations ['fc42ea03-eb3f-4b5b-9b6b-bd8b1451ad55', '76555096-8eb3-420c-be87-0d95f3042fee', '7d133a38-b958-4af4-808c-80dc4e2babb4', '451bb5e0-2a20-4e60-bd3e-e3d9c3b0493b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:58 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.info" returned: 0 in 0.341s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Flow 'volume_create_manager' (349524ec-2d3a-4d86-87c0-582d8243154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5259ac-c105-4875-a1c7-9cf96c3f03fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5259ac-c105-4875-a1c7-9cf96c3f03fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1534826435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cac0bfb-932a-4d28-86ee-4cfe6bd57d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8983dc51e60c47f2a3c143b70b67b7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:59Z,use_quota=True,user_id='4ab06f35404149408f496ea61dd1bcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f0b688-b015-4e32-8062-c6ccd0ef11fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f0b688-b015-4e32-8062-c6ccd0ef11fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59624c9c-cff3-4866-8636-d31d7ad27569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59624c9c-cff3-4866-8636-d31d7ad27569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cac0bfb-932a-4d28-86ee-4cfe6bd57d44', 'volume_name': 'volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c8094d-4478-4e35-98a4-3102bc28b1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c8094d-4478-4e35-98a4-3102bc28b1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229de97c-da4f-4473-9ebf-7450a59e22b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:58 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Volume 1cac0bfb-932a-4d28-86ee-4cfe6bd57d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44', 'volume_size': 1} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1534826435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cac0bfb-932a-4d28-86ee-4cfe6bd57d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8983dc51e60c47f2a3c143b70b67b7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:59Z,use_quota=True,user_id='4ab06f35404149408f496ea61dd1bcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Creating volume 1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:58 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 1073741824 Jul 30 16:46:58 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72" returned: 0 in 0.485s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b4fd4f8e-102e-4193-a0d7-08619a97ddd0 tempest-CinderUnicodeTest-1555420935 None] Create snapshot completed successfully Jul 30 16:46:58 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72 Jul 30 16:46:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:46:58 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4e8489b6-f295-40d0-a9af-06ac98ae4d93 tempest-ProjectMemberTests-402676597 None] Lock "cinder-a9ba4959-cdb2-4214-918c-2d3bccbd1f08-delete_snapshot" released by "delete_snapshot" :: held 2.465s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:59 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07ee8118-6238-4b13-8932-95700fcebb72" returned: 0 in 0.299s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-07ee8118-6238-4b13-8932-95700fcebb72" released by "delete_volume" :: held 0.858s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created reservations ['1dd50e8e-2ed5-4ad6-84de-9305ddcdf5f0', '09481e7b-c4d4-4ab8-96e6-b3a788f0ed72', 'd8f24852-e2cb-4086-b212-2b8cbb849a58', 'becfe923-4cfb-45a5-9147-510ec4f0e389'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:59 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 1073741824" returned: 0 in 0.442s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:59 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 Jul 30 16:46:59 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "cinder-b5a37db0-c18e-4f01-95ec-9fadc7978cdd-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-4f921b35-1dda-4802-844c-c6dfdeaddf3b-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:59 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:46:59 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-b5a37db0-c18e-4f01-95ec-9fadc7978cdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "cinder-quobyte-db6181af-2518-4cea-80cb-d2d4da43c42d" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-4f921b35-1dda-4802-844c-c6dfdeaddf3b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-quobyte-db6181af-2518-4cea-80cb-d2d4da43c42d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "cinder-quobyte-b5a37db0-c18e-4f01-95ec-9fadc7978cdd" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-quobyte-b5a37db0-c18e-4f01-95ec-9fadc7978cdd" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Deleting offline snapshot b5a37db0-c18e-4f01-95ec-9fadc7978cdd of volume db6181af-2518-4cea-80cb-d2d4da43c42d {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] snapshot_file for this snap is: volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ed6fad-d6b2-4bfb-8bba-b78843e37afb]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-quobyte-4f921b35-1dda-4802-844c-c6dfdeaddf3b" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-4f921b35-1dda-4802-844c-c6dfdeaddf3b" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c569fac-e916-4fc7-a5e6-1425b97bc22f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:59 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" returned: 0 in 0.374s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:59 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.355s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:59 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd Jul 30 16:46:59 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Deleted volume successfully. Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229de97c-da4f-4473-9ebf-7450a59e22b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4089b958-c066-4e8e-bb8d-bbc373c6b795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-6e140664-0f90-4574-bbc9-4e4930db97b7-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:59 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b Jul 30 16:46:59 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ee8438e9-86ce-42e0-af8a-699f6d35c188 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-07ee8118-6238-4b13-8932-95700fcebb72-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:59 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Volume volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 (1cac0bfb-932a-4d28-86ee-4cfe6bd57d44): created successfully Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4089b958-c066-4e8e-bb8d-bbc373c6b795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Flow 'volume_create_manager' (349524ec-2d3a-4d86-87c0-582d8243154b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Lock "cinder-6e140664-0f90-4574-bbc9-4e4930db97b7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5d5b675c-b279-4b46-9346-32ca1a9e63d4 tempest-VolumeDependencyTests-87426852 None] Created volume successfully. Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-6e140664-0f90-4574-bbc9-4e4930db97b7" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:59 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6e140664-0f90-4574-bbc9-4e4930db97b7" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92d4ffe-3ff1-4bf6-b875-f5a31766c31a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:00 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd" returned: 0 in 0.444s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db6181af-2518-4cea-80cb-d2d4da43c42d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26bdeaf-9c2a-43c5-b022-c9b13b303b10]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:00 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 Jul 30 16:47:00 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:00 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b" returned: 0 in 0.489s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:00 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b Jul 30 16:47:00 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:00 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d Jul 30 16:47:00 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:00 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7" returned: 0 in 0.377s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:00 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7 Jul 30 16:47:00 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:00 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-4f921b35-1dda-4802-844c-c6dfdeaddf3b" returned: 0 in 0.284s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-4f921b35-1dda-4802-844c-c6dfdeaddf3b" released by "delete_volume" :: held 0.825s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:00 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d" returned: 0 in 0.405s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:00 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd Jul 30 16:47:00 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created reservations ['da397eb5-2b9d-47e4-982e-2fdbb69f41b3', '4f248496-f988-4019-a9a9-0fb3e41d183e', '0d270d0f-5307-4c1c-b0bf-5b78b5c6af66', 'b31d00d1-18d2-40a7-8d16-14bd9828038c'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:00 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6e140664-0f90-4574-bbc9-4e4930db97b7" returned: 0 in 0.315s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:00 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:00 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6e140664-0f90-4574-bbc9-4e4930db97b7" released by "delete_volume" :: held 0.765s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-49e52898-4eac-4c4f-8340-da302916d2eb-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-49e52898-4eac-4c4f-8340-da302916d2eb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "cinder-quobyte-49e52898-4eac-4c4f-8340-da302916d2eb" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Created reservations ['711b6e62-88b4-498f-937a-691373dba9ea', 'b7a6c68d-d9bb-49bb-ae42-4ee42ed0b7fa', '3927a646-66bb-4158-bf0f-15112000b564', '60838836-6a56-4590-9ea7-ad7ffd949baf'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-49e52898-4eac-4c4f-8340-da302916d2eb" acquired by "delete_volume" :: waited 0.050s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9734f0cf-8b51-4647-9887-186ed8eada4b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.379s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:01 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd" returned: 0 in 0.574s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Deleted volume successfully. Jul 30 16:47:01 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd Jul 30 16:47:01 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-4596ed97-566a-4b42-8975-ad06a869b9cd tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-4f921b35-1dda-4802-844c-c6dfdeaddf3b-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb Jul 30 16:47:01 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Creating offline snapshot e951e59d-d41f-4d90-b1f3-451203c44bb6 of volume 1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:01 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:01 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782f735-ad95-4f20-af6b-eb714d0c0ab4]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 Jul 30 16:47:01 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d.b5a37db0-c18e-4f01-95ec-9fadc7978cdd" returned: 0 in 0.294s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-quobyte-b5a37db0-c18e-4f01-95ec-9fadc7978cdd" released by "_delete_snapshot" :: held 1.846s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:01 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.280s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-quobyte-db6181af-2518-4cea-80cb-d2d4da43c42d" released by "delete_snapshot" :: held 1.900s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:47:01 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb" returned: 0 in 0.453s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d7518890-c2bf-4efa-b5f4-3916e62e05b0 tempest-ProjectMemberTests-402676597 None] Lock "cinder-6e140664-0f90-4574-bbc9-4e4930db97b7-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:01 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb Jul 30 16:47:01 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Created reservations ['4f7bf9e4-18e7-4daf-b5aa-dbd255b9e50c', '2be1d5f5-2c93-43d5-b474-d051a82d1a9e', '0f643315-cf72-407c-8ebf-b036bd6f57cf', '37bc5217-073f-4b92-b9d3-b8f6caebdfa0'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Delete snapshot completed successfully. Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-ed7be5b2-25b5-463c-a904-ddfed412ff86 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-b5a37db0-c18e-4f01-95ec-9fadc7978cdd-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:01 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" returned: 0 in 0.435s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 1G Jul 30 16:47:01 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-49e52898-4eac-4c4f-8340-da302916d2eb" returned: 0 in 0.290s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-quobyte-49e52898-4eac-4c4f-8340-da302916d2eb" released by "delete_volume" :: held 0.822s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Created reservations ['67e195db-f3e0-4a95-b781-412a7ee606b5', '4b223687-ce71-4e78-80bd-aed40f4c9074', '57a3eda3-7264-40d8-b197-30f1f74abef3', '8915f9fe-2bb0-46c4-9c20-383e666c5d32'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:01 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:02 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 1G" returned: 0 in 0.507s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:02 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 Jul 30 16:47:02 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:02 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.307s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Deleted volume successfully. Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-e37b4431-9982-4ff4-b2c0-c618ed4949d7 tempest-CreateVolumesFromSourceVolumeTest-1377694891 None] Lock "cinder-49e52898-4eac-4c4f-8340-da302916d2eb-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:02 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6" returned: 0 in 0.338s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:02 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 is being set with open permissions: ugo+rw Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:02 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 Jul 30 16:47:02 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "cinder-db6181af-2518-4cea-80cb-d2d4da43c42d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-db6181af-2518-4cea-80cb-d2d4da43c42d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "cinder-quobyte-db6181af-2518-4cea-80cb-d2d4da43c42d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:02 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-quobyte-db6181af-2518-4cea-80cb-d2d4da43c42d" acquired by "delete_volume" :: waited 0.054s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6" returned: 0 in 0.419s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8274adc-fd0a-46ae-8e7c-7337c7a62148]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:02 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.info Jul 30 16:47:02 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (76d21484-3c6a-4dc7-a280-cb4c3d484335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fe9188-e7d5-401a-a811-427a6582bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:03 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d Jul 30 16:47:03 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fe9188-e7d5-401a-a811-427a6582bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115450730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6629dbf7-b9ad-47b0-9a20-086a0eb31d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:03Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c2c7a4-69f5-4976-b3c2-db78018d0f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c2c7a4-69f5-4976-b3c2-db78018d0f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e042fc-a6c4-4516-8c3e-6b6c6ac65d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e042fc-a6c4-4516-8c3e-6b6c6ac65d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6629dbf7-b9ad-47b0-9a20-086a0eb31d41', 'volume_name': 'volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ae7f14-9697-452b-933b-e7544d0fcdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ae7f14-9697-452b-933b-e7544d0fcdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818a7c67-242e-4c12-bf8a-a45e68f2e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:03 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Volume 6629dbf7-b9ad-47b0-9a20-086a0eb31d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41', 'volume_size': 1} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:03 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.info" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:03 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.info is being set with open permissions: ugo+rw Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:03 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.info Jul 30 16:47:03 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:03 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d" returned: 0 in 0.482s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:03 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d Jul 30 16:47:03 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:03 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.info" returned: 0 in 0.284s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115450730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6629dbf7-b9ad-47b0-9a20-086a0eb31d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:03Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Creating volume 6629dbf7-b9ad-47b0-9a20-086a0eb31d41 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:03 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:03 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 1073741824 Jul 30 16:47:03 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:03 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f543eb1d-6875-48a3-b7b3-50b0e894e6f9 tempest-VolumeDependencyTests-87426852 None] Create snapshot completed successfully Jul 30 16:47:03 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-db6181af-2518-4cea-80cb-d2d4da43c42d" returned: 0 in 0.311s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-quobyte-db6181af-2518-4cea-80cb-d2d4da43c42d" released by "delete_volume" :: held 0.876s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:03 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Created reservations ['ea04fed1-13ab-4667-8ab3-4829e9780ac8', '98cf2cc8-c4ff-4415-90f1-bc52a7fa4f86', 'f2306d6a-2811-44e5-8720-a8a1999b65a4', '1621c894-46e6-48df-ac5f-f9dd325bd357'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:04 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:04 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:04 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 1073741824" returned: 0 in 0.649s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:04 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.289s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Deleted volume successfully. Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6028f285-bc2f-4032-91c7-c47ddacbac34 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-db6181af-2518-4cea-80cb-d2d4da43c42d-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:04 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 Jul 30 16:47:04 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:04 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" returned: 0 in 0.265s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818a7c67-242e-4c12-bf8a-a45e68f2e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af0eb6c-c326-45dd-954b-190c0e53bbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:04 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Volume volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 (6629dbf7-b9ad-47b0-9a20-086a0eb31d41): created successfully Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af0eb6c-c326-45dd-954b-190c0e53bbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (76d21484-3c6a-4dc7-a280-cb4c3d484335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-892f02f1-be01-4ef0-9242-3e6b205a1783 tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Flow 'volume_create_manager' (ee9c62a2-66b5-4026-8447-920c31148d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:04 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84ecb00-cecb-4ffd-9d97-8c6550ff5f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84ecb00-cecb-4ffd-9d97-8c6550ff5f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-883068246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75beb415-3d90-4d40-85ba-dfa26c59819d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8983dc51e60c47f2a3c143b70b67b7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e951e59d-d41f-4d90-b1f3-451203c44bb6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:05Z,use_quota=True,user_id='4ab06f35404149408f496ea61dd1bcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db3af63-360e-4b4c-9c22-8f04853395a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db3af63-360e-4b4c-9c22-8f04853395a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763d04f7-4243-4f62-9c70-9cdef3061960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763d04f7-4243-4f62-9c70-9cdef3061960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75beb415-3d90-4d40-85ba-dfa26c59819d', 'volume_name': 'volume-75beb415-3d90-4d40-85ba-dfa26c59819d', 'volume_size': 1, 'snapshot_id': 'e951e59d-d41f-4d90-b1f3-451203c44bb6'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f98b8f-ccff-4ac2-b362-049b6685e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f98b8f-ccff-4ac2-b362-049b6685e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7b2dd7-47aa-43ba-b05e-df06e5df9d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:05 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Volume 75beb415-3d90-4d40-85ba-dfa26c59819d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75beb415-3d90-4d40-85ba-dfa26c59819d', 'volume_size': 1, 'snapshot_id': 'e951e59d-d41f-4d90-b1f3-451203c44bb6'} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "cinder-03e1907a-21e7-4562-856a-9be25dc60b14-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-quobyte-e951e59d-d41f-4d90-b1f3-451203c44bb6-75beb415-3d90-4d40-85ba-dfa26c59819d" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-03e1907a-21e7-4562-856a-9be25dc60b14-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-e951e59d-d41f-4d90-b1f3-451203c44bb6-75beb415-3d90-4d40-85ba-dfa26c59819d" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Creating volume 75beb415-3d90-4d40-85ba-dfa26c59819d from snapshot e951e59d-d41f-4d90-b1f3-451203c44bb6 {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-quobyte-75beb415-3d90-4d40-85ba-dfa26c59819d" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "cinder-quobyte-03e1907a-21e7-4562-856a-9be25dc60b14" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-75beb415-3d90-4d40-85ba-dfa26c59819d" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] snapshot: e951e59d-d41f-4d90-b1f3-451203c44bb6, volume: 75beb415-3d90-4d40-85ba-dfa26c59819d, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-quobyte-03e1907a-21e7-4562-856a-9be25dc60b14" acquired by "delete_volume" :: waited 0.067s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[281e7e0f-e10b-4513-859a-83746011fb28]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[885c5476-e937-4df8-9b8d-2d3978e1c9a2]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:05 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 Jul 30 16:47:05 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:05 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 Jul 30 16:47:05 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:05 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6" returned: 0 in 0.441s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:05 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14" returned: 0 in 0.431s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3559e100-5c23-403b-aff5-d7b8328ba924]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:05 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14 Jul 30 16:47:05 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:05 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 Jul 30 16:47:05 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:05 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-03e1907a-21e7-4562-856a-9be25dc60b14" returned: 0 in 0.286s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-quobyte-03e1907a-21e7-4562-856a-9be25dc60b14" released by "delete_volume" :: held 0.770s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Created reservations ['b891c2c9-41aa-4d23-a896-4b48defaf4cb', 'e4cf03ec-bd8f-4e60-80b1-c17cb7379862', '77ce8489-9d4f-43cc-b429-b60b73e1ae36', 'a82f218e-c6a2-4177-bf61-1d70752e4fb8'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:06 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" returned: 0 in 0.405s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:06 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d Jul 30 16:47:06 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:06 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:06 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:06 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.286s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:06 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Deleted volume successfully. Jul 30 16:47:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fa2d3413-f187-4ea3-a228-9eaa56ee8543 tempest-CinderUnicodeTest-1555420935 None] Lock "cinder-03e1907a-21e7-4562-856a-9be25dc60b14-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:11 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d" returned: 0 in 5.536s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:11 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:47:11 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Converted 1024.00 MB image at 184.90 MB/s Jul 30 16:47:11 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d is being set with open permissions: ugo+rw Jul 30 16:47:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:11 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d Jul 30 16:47:11 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:11 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d" returned: 0 in 0.323s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-75beb415-3d90-4d40-85ba-dfa26c59819d" released by "_copy_volume_from_snapshot" :: held 6.824s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-e951e59d-d41f-4d90-b1f3-451203c44bb6-75beb415-3d90-4d40-85ba-dfa26c59819d" released by "_create_volume_from_snapshot" :: held 6.928s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.964s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.674s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Creating offline snapshot 2c111977-3503-40b0-8cd7-ca77737a4eb3 of volume 6629dbf7-b9ad-47b0-9a20-086a0eb31d41 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7b2dd7-47aa-43ba-b05e-df06e5df9d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75beb415-3d90-4d40-85ba-dfa26c59819d', 'volume_size': 1, 'snapshot_id': 'e951e59d-d41f-4d90-b1f3-451203c44bb6'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd705b34-bb00-46f5-9e2b-9fd7d2a82272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc39d3d0-aae5-4d87-a5d3-080111c5e727]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:12 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Volume volume-75beb415-3d90-4d40-85ba-dfa26c59819d (75beb415-3d90-4d40-85ba-dfa26c59819d): created successfully Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd705b34-bb00-46f5-9e2b-9fd7d2a82272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Flow 'volume_create_manager' (ee9c62a2-66b5-4026-8447-920c31148d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:12 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c564a59a-edc1-46a9-b4b3-ad159f19aa88 tempest-VolumeDependencyTests-87426852 None] Created volume successfully. Jul 30 16:47:12 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 Jul 30 16:47:12 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:12 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" returned: 0 in 0.392s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:12 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 1G Jul 30 16:47:12 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:12 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-18445bd8-3aab-42ad-b5c1-16eb5c242b4d tempest-ProjectAdminTests-20617104 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576942443848, 'free_capacity_gb': 1775.7576942443848, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:47:13 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 1G" returned: 0 in 0.538s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:13 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 Jul 30 16:47:13 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-e951e59d-d41f-4d90-b1f3-451203c44bb6-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-e951e59d-d41f-4d90-b1f3-451203c44bb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-quobyte-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-quobyte-e951e59d-d41f-4d90-b1f3-451203c44bb6" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-e951e59d-d41f-4d90-b1f3-451203c44bb6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Deleting offline snapshot e951e59d-d41f-4d90-b1f3-451203c44bb6 of volume 1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] snapshot_file for this snap is: volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eb6644-ea7f-4c7b-bdfd-b26f42ce1354]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:13 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 Jul 30 16:47:13 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:13 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3" returned: 0 in 0.391s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:13 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 is being set with open permissions: ugo+rw Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:13 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 Jul 30 16:47:13 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:13 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6" returned: 0 in 0.412s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c2996-f362-454d-8f93-281a1a78a251]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:13 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3" returned: 0 in 0.350s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:13 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 Jul 30 16:47:13 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:13 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.info Jul 30 16:47:13 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:14 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.info" returned: 0 in 0.394s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:14 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.info is being set with open permissions: ugo+rw Jul 30 16:47:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:14 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.info Jul 30 16:47:14 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:14 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" returned: 0 in 0.722s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:14 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 Jul 30 16:47:14 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:14 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.info" returned: 0 in 0.353s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.560s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-70bf52fb-55fb-48e8-be1f-c27b5e08d8e5 tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:47:14 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6" returned: 0 in 0.456s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:14 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6 Jul 30 16:47:14 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-2c111977-3503-40b0-8cd7-ca77737a4eb3-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Lock "cinder-2c111977-3503-40b0-8cd7-ca77737a4eb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-2c111977-3503-40b0-8cd7-ca77737a4eb3" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-2c111977-3503-40b0-8cd7-ca77737a4eb3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot 2c111977-3503-40b0-8cd7-ca77737a4eb3 of volume 6629dbf7-b9ad-47b0-9a20-086a0eb31d41 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811a7c9-0a2b-41fc-bec8-7fae5c3ce15d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:15 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44.e951e59d-d41f-4d90-b1f3-451203c44bb6" returned: 0 in 0.274s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-e951e59d-d41f-4d90-b1f3-451203c44bb6" released by "_delete_snapshot" :: held 2.017s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:15 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 Jul 30 16:47:15 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" released by "delete_snapshot" :: held 2.049s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Created reservations ['b0592bfc-fe24-4423-b9f7-2957c6bdd14a', '2064138c-2423-4461-837b-cc7185c1e96c', '1c6093e8-db1f-4641-8e67-ad916c89fc8c', '644baa11-b9e3-49ea-a687-a38d91a5157a'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:15 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Delete snapshot completed successfully. Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-df503e62-d428-4dde-aca1-417a3ae5a884 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-e951e59d-d41f-4d90-b1f3-451203c44bb6-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:15 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3" returned: 0 in 0.404s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9170b87-9456-4cc1-b215-de9938432088]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:15 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 Jul 30 16:47:15 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:15 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" returned: 0 in 0.403s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:15 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 Jul 30 16:47:16 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:16 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3" returned: 0 in 0.401s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:16 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3 Jul 30 16:47:16 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-quobyte-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" acquired by "delete_volume" :: waited 0.027s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64b335-6040-45a7-8cae-58046a94650e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:16 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 Jul 30 16:47:16 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:16 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41.2c111977-3503-40b0-8cd7-ca77737a4eb3" returned: 0 in 0.363s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-2c111977-3503-40b0-8cd7-ca77737a4eb3" released by "_delete_snapshot" :: held 1.721s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" released by "delete_snapshot" :: held 1.753s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Created reservations ['ed967aa6-393f-4d56-85ae-fe06054629b6', '2f7a62b9-cdb8-41c3-9098-641441beeb05', '78a8fba5-3051-4028-a9e6-800fdbb7e906', '3f8efbe9-b096-4b7e-b09b-561fd7d72af1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:16 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:47:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0551e946-ead5-4847-ab01-bf756556564a tempest-ProjectMemberTests-402676597 None] Lock "cinder-2c111977-3503-40b0-8cd7-ca77737a4eb3-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:17 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" returned: 0 in 0.466s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:17 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44 Jul 30 16:47:17 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-6629dbf7-b9ad-47b0-9a20-086a0eb31d41-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Lock "cinder-6629dbf7-b9ad-47b0-9a20-086a0eb31d41-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:17 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44" released by "delete_volume" :: held 0.823s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097fb59-edb2-449e-b1e0-45eac183f5d8]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Created reservations ['1f66de7a-8fcb-4ac4-a231-a9cfa26f286c', 'db2a0588-6ebb-4c16-9940-99f3c6d779b2', 'a941732c-6db8-4a71-985e-ea7aa7efdfb8', 'f1b503f2-6557-4f6a-a40d-d06abfa76e62'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:17 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 Jul 30 16:47:17 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:17 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:17 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-75beb415-3d90-4d40-85ba-dfa26c59819d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Lock "cinder-75beb415-3d90-4d40-85ba-dfa26c59819d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Acquiring lock "cinder-quobyte-75beb415-3d90-4d40-85ba-dfa26c59819d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-75beb415-3d90-4d40-85ba-dfa26c59819d" acquired by "delete_volume" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef00a88-c2ee-42cb-82ce-cb11c8cacc00]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:17 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" returned: 0 in 0.537s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:17 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41 Jul 30 16:47:17 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:17 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.402s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:17 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Deleted volume successfully. Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-96022347-7e3d-4de1-a8fb-465df18c9939 tempest-VolumeDependencyTests-87426852 None] Lock "cinder-1cac0bfb-932a-4d28-86ee-4cfe6bd57d44-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:18 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d Jul 30 16:47:18 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:18 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" returned: 0 in 0.311s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6629dbf7-b9ad-47b0-9a20-086a0eb31d41" released by "delete_volume" :: held 0.911s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Created reservations ['e79028a7-02b5-44e5-be66-a52afd22c9f8', 'b3546af0-729d-405e-b4c2-8e0b328bd00d', '55cb561a-90ed-4127-9637-c1df1b0e51fc', '007820c0-697a-4be6-9341-895e6a11e802'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:18 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d" returned: 0 in 0.475s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:18 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d Jul 30 16:47:18 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:18 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:18 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:18 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-75beb415-3d90-4d40-85ba-dfa26c59819d" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Lock "cinder-quobyte-75beb415-3d90-4d40-85ba-dfa26c59819d" released by "delete_volume" :: held 0.945s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Created reservations ['039f7339-5d45-4873-b41e-5ca4b6454e02', '9c42f5e4-22b7-4b4a-ad01-23731cf08428', '855312a8-a4f2-4e85-9d04-4a8c5581e7db', '967a38de-f03e-4d84-acfc-1955fec7f9e8'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:18 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.405s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:18 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-481a9df1-068e-4d37-9670-cb6c4e5ab1da tempest-ProjectMemberTests-402676597 None] Lock "cinder-6629dbf7-b9ad-47b0-9a20-086a0eb31d41-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:19 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:19 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:19 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.280s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:19 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:19 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Deleted volume successfully. Jul 30 16:47:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c022d5b7-a995-49c3-b0d2-1ea326ee043e tempest-VolumeDependencyTests-87426852 None] Lock "cinder-75beb415-3d90-4d40-85ba-dfa26c59819d-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (883d1b23-ca68-4c9c-b4dd-16e642d11598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6d0668-08b2-4d87-a193-e9c69265affe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6d0668-08b2-4d87-a193-e9c69265affe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371096229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bba823-859c-4a46-b2e9-7d2f5856d05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:20Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311d86e1-1cf4-45ba-a399-f086607bac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311d86e1-1cf4-45ba-a399-f086607bac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd47b315-b053-44b0-87ed-096881339b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd47b315-b053-44b0-87ed-096881339b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bba823-859c-4a46-b2e9-7d2f5856d05a', 'volume_name': 'volume-62bba823-859c-4a46-b2e9-7d2f5856d05a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04128f1-ab89-48dd-a713-c307b3d967e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04128f1-ab89-48dd-a713-c307b3d967e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35df05c9-a014-48ef-b29d-669cd52ed5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:20 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Volume 62bba823-859c-4a46-b2e9-7d2f5856d05a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bba823-859c-4a46-b2e9-7d2f5856d05a', 'volume_size': 1} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-371096229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bba823-859c-4a46-b2e9-7d2f5856d05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:20Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Creating volume 62bba823-859c-4a46-b2e9-7d2f5856d05a {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:20 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:20 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a 1073741824 Jul 30 16:47:20 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:20 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a 1073741824" returned: 0 in 0.470s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:20 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a Jul 30 16:47:20 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:21 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a" returned: 0 in 0.306s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:21 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:21 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35df05c9-a014-48ef-b29d-669cd52ed5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bba823-859c-4a46-b2e9-7d2f5856d05a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5c69ff-d152-425c-8d81-b43ea541c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:21 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Volume volume-62bba823-859c-4a46-b2e9-7d2f5856d05a (62bba823-859c-4a46-b2e9-7d2f5856d05a): created successfully Jul 30 16:47:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5c69ff-d152-425c-8d81-b43ea541c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:21 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (883d1b23-ca68-4c9c-b4dd-16e642d11598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:21 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6af13d8a-dc5b-4d66-ae16-95fd3a1f4d51 tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:47:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:22 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Creating offline snapshot d1b3e380-8a30-4474-af01-7a9d989ed16a of volume 62bba823-859c-4a46-b2e9-7d2f5856d05a {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:22 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3348b2e5-ed56-4d50-97cd-e6f504f0be59]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:22 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a Jul 30 16:47:22 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:22 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a" returned: 0 in 0.405s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:22 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:22 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a 1G Jul 30 16:47:22 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:23 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a 1G" returned: 0 in 0.521s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bba823-859c-4a46-b2e9-7d2f5856d05a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:23 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bba823-859c-4a46-b2e9-7d2f5856d05a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a Jul 30 16:47:23 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:23 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bba823-859c-4a46-b2e9-7d2f5856d05a -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a" returned: 0 in 0.361s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:23 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a is being set with open permissions: ugo+rw Jul 30 16:47:23 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:23 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a Jul 30 16:47:23 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:23 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a" returned: 0 in 0.289s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:24 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=247,cinder:UPDATE=319,cinder:INSERT=88,cinder:DELETE=28 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:47:24 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=316,cinder:SELECT=225,cinder:INSERT=82,cinder:DELETE=28 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:47:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:24 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.info Jul 30 16:47:24 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:24 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.info" returned: 0 in 0.300s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:24 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.info is being set with open permissions: ugo+rw Jul 30 16:47:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:24 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.info Jul 30 16:47:24 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:24 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.info" returned: 0 in 0.268s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:24 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:24 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ee210739-5130-47da-ada5-ec7bcb52e1c5 tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-d1b3e380-8a30-4474-af01-7a9d989ed16a-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Lock "cinder-d1b3e380-8a30-4474-af01-7a9d989ed16a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-62bba823-859c-4a46-b2e9-7d2f5856d05a" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-62bba823-859c-4a46-b2e9-7d2f5856d05a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-d1b3e380-8a30-4474-af01-7a9d989ed16a" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-d1b3e380-8a30-4474-af01-7a9d989ed16a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot d1b3e380-8a30-4474-af01-7a9d989ed16a of volume 62bba823-859c-4a46-b2e9-7d2f5856d05a {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ba9982-311a-49f1-9d08-157e19ac264f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:25 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:25 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a Jul 30 16:47:25 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Flow 'volume_create_manager' (993415cf-62cc-4507-955b-ae3d166542dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c228c2d-a9a8-44ae-90f7-5584cfe7f4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c228c2d-a9a8-44ae-90f7-5584cfe7f4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313828371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09302135-134d-407d-8eac-6b89c94849c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465a7828c3264069b596acc3f48a3d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:26Z,use_quota=True,user_id='cf32638b7d924482aceda999ef06eadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32230e7a-aa86-4c84-8032-d235cf9eb644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32230e7a-aa86-4c84-8032-d235cf9eb644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea630165-2012-4903-a3af-0ca47772a42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea630165-2012-4903-a3af-0ca47772a42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09302135-134d-407d-8eac-6b89c94849c2', 'volume_name': 'volume-09302135-134d-407d-8eac-6b89c94849c2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dea9ff3-4d6c-4c13-9ac8-eb20bc3b72d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dea9ff3-4d6c-4c13-9ac8-eb20bc3b72d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40355989-17a6-45a3-a8aa-92c0fb08838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:26 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Volume 09302135-134d-407d-8eac-6b89c94849c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09302135-134d-407d-8eac-6b89c94849c2', 'volume_size': 1} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313828371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09302135-134d-407d-8eac-6b89c94849c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465a7828c3264069b596acc3f48a3d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:26Z,use_quota=True,user_id='cf32638b7d924482aceda999ef06eadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Creating volume 09302135-134d-407d-8eac-6b89c94849c2 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:26 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:26 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 1073741824 Jul 30 16:47:26 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:26 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a" returned: 0 in 0.520s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62bba823-859c-4a46-b2e9-7d2f5856d05a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6896c4f-f00d-4517-be1e-f8d7fa5f86f9]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:26 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a Jul 30 16:47:26 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:26 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 1073741824" returned: 0 in 0.572s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:26 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a" returned: 0 in 0.485s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:26 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a Jul 30 16:47:26 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:26 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:26 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 Jul 30 16:47:26 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:27 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2" returned: 0 in 0.284s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40355989-17a6-45a3-a8aa-92c0fb08838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09302135-134d-407d-8eac-6b89c94849c2', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759dcb43-13ef-4d5e-8fa7-078ace041262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:27 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Volume volume-09302135-134d-407d-8eac-6b89c94849c2 (09302135-134d-407d-8eac-6b89c94849c2): created successfully Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759dcb43-13ef-4d5e-8fa7-078ace041262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Flow 'volume_create_manager' (993415cf-62cc-4507-955b-ae3d166542dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:27 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a9fcc9be-317d-4410-90b4-cc2782ec170d tempest-ProjectReaderTests-48003810 None] Created volume successfully. Jul 30 16:47:27 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a" returned: 0 in 0.525s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:27 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a Jul 30 16:47:27 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:27 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a.d1b3e380-8a30-4474-af01-7a9d989ed16a" returned: 0 in 0.289s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-d1b3e380-8a30-4474-af01-7a9d989ed16a" released by "_delete_snapshot" :: held 1.981s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-62bba823-859c-4a46-b2e9-7d2f5856d05a" released by "delete_snapshot" :: held 2.026s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:27 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Created reservations ['2f196534-b35a-44c1-9d62-f4a142542ab1', 'e5bd57f3-7fb1-4c3b-9bf8-f2294a5d2b2b', 'db133f97-319f-45d0-a832-d86baee66e16', 'b3faccee-dab7-419b-8f1d-36bfce6bdfb0'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:28 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-82a5a2e1-dc93-491f-b913-d1fd7628d3e8 tempest-ProjectMemberTests-402676597 None] Lock "cinder-d1b3e380-8a30-4474-af01-7a9d989ed16a-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Acquiring lock "cinder-09302135-134d-407d-8eac-6b89c94849c2-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Lock "cinder-09302135-134d-407d-8eac-6b89c94849c2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Acquiring lock "cinder-quobyte-09302135-134d-407d-8eac-6b89c94849c2" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Lock "cinder-quobyte-09302135-134d-407d-8eac-6b89c94849c2" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede1e000-946b-48a5-8764-a92ae08db475]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Flow 'volume_create_manager' (2625fd30-620c-4411-a9b2-2e6e272e39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bedff49-aaea-4e39-99a1-265b65611af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bedff49-aaea-4e39-99a1-265b65611af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116348177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8873ffc1824466babc021aed07d4711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:29Z,use_quota=True,user_id='c7a07b7434b34c4b8bc507a8fe55cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9248d96c-7e32-4a39-8ecc-09191c6761f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:28 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 Jul 30 16:47:28 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9248d96c-7e32-4a39-8ecc-09191c6761f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20619c5-f50a-4a5b-a3a9-3538ed534739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20619c5-f50a-4a5b-a3a9-3538ed534739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d', 'volume_name': 'volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1c88be-a67c-4a4c-81f6-c6717c12295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1c88be-a67c-4a4c-81f6-c6717c12295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac5e077-0636-4d30-a9b0-ccf472bfa9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:28 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Volume 44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d', 'volume_size': 1} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116348177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8873ffc1824466babc021aed07d4711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:29Z,use_quota=True,user_id='c7a07b7434b34c4b8bc507a8fe55cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Creating volume 44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:28 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:28 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d 1073741824 Jul 30 16:47:28 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-62bba823-859c-4a46-b2e9-7d2f5856d05a-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:28 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Lock "cinder-62bba823-859c-4a46-b2e9-7d2f5856d05a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-62bba823-859c-4a46-b2e9-7d2f5856d05a" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:29 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2" returned: 0 in 0.511s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-62bba823-859c-4a46-b2e9-7d2f5856d05a" acquired by "delete_volume" :: waited 0.029s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:29 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2 Jul 30 16:47:29 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8857b-180a-4746-81a5-1130a17450cf]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:29 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a Jul 30 16:47:29 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:29 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d 1073741824" returned: 0 in 0.580s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:29 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-09302135-134d-407d-8eac-6b89c94849c2" returned: 0 in 0.293s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:29 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d Jul 30 16:47:29 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Lock "cinder-quobyte-09302135-134d-407d-8eac-6b89c94849c2" released by "delete_volume" :: held 0.859s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Created reservations ['d4cb9003-9aa1-46e1-bbae-25e3335f5591', 'ba84c9b4-c629-4396-bd8a-d368f9d7a2f4', 'ad94dd49-32ee-47c6-896d-5c936929d652', '9aecad05-9a55-4d66-919d-4cbbb68ef0e0'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:29 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a" returned: 0 in 0.488s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:29 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:29 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:29 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a Jul 30 16:47:29 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:29 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d" returned: 0 in 0.408s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac5e077-0636-4d30-a9b0-ccf472bfa9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f49502-ce07-4c25-9d2f-6db9c1126be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:29 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Volume volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d (44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d): created successfully Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f49502-ce07-4c25-9d2f-6db9c1126be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Flow 'volume_create_manager' (2625fd30-620c-4411-a9b2-2e6e272e39ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:29 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-063583ef-f2e9-4b5e-a7e9-5f5c340ee3e4 tempest-ProjectReaderTests-69934351 None] Created volume successfully. Jul 30 16:47:29 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.388s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:29 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Deleted volume successfully. Jul 30 16:47:29 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-12d7922d-fda4-454c-a782-a46c8fcc12f5 tempest-ProjectReaderTests-48003810 None] Lock "cinder-09302135-134d-407d-8eac-6b89c94849c2-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:29 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-62bba823-859c-4a46-b2e9-7d2f5856d05a" returned: 0 in 0.404s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-62bba823-859c-4a46-b2e9-7d2f5856d05a" released by "delete_volume" :: held 0.968s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Created reservations ['cd2c42bf-44a8-45d9-97d2-61c1862c5da9', 'eb3d9cd9-62fd-4096-8a1a-8257f797cc86', '87a32b8d-8c53-4738-8058-3c0019438913', '8d462ed4-da81-49f8-a406-a817a76d4a8e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:30 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:30 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Flow 'volume_create_manager' (307cf537-df70-4caf-b09e-a005b8d1fa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fa6957-96fd-47d7-8e6c-0d1539357703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fa6957-96fd-47d7-8e6c-0d1539357703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877397210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc66f145-cd8b-4c15-bf2c-b93e83a9d71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465a7828c3264069b596acc3f48a3d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:30Z,use_quota=True,user_id='cf32638b7d924482aceda999ef06eadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ea48b3-855b-48db-bc7f-9f7c424f8e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ea48b3-855b-48db-bc7f-9f7c424f8e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d71482e-284e-4d37-a199-04481e822788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d71482e-284e-4d37-a199-04481e822788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc66f145-cd8b-4c15-bf2c-b93e83a9d71a', 'volume_name': 'volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1e0680-80ff-4be1-b9a5-59ca1988382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1e0680-80ff-4be1-b9a5-59ca1988382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c06e6f5-6e78-4dc5-90a9-2ace7c24ca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Volume cc66f145-cd8b-4c15-bf2c-b93e83a9d71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a', 'volume_size': 1} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877397210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc66f145-cd8b-4c15-bf2c-b93e83a9d71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465a7828c3264069b596acc3f48a3d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:30Z,use_quota=True,user_id='cf32638b7d924482aceda999ef06eadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Creating volume cc66f145-cd8b-4c15-bf2c-b93e83a9d71a {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:30 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:30 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a 1073741824 Jul 30 16:47:30 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:30 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.306s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:30 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-1419ea5b-415f-4f38-a02c-67ccf0cc40c3 tempest-ProjectMemberTests-402676597 None] Lock "cinder-62bba823-859c-4a46-b2e9-7d2f5856d05a-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:30 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a 1073741824" returned: 0 in 0.527s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:30 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:30 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a Jul 30 16:47:30 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Acquiring lock "cinder-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Lock "cinder-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:31 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a" returned: 0 in 0.299s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Acquiring lock "cinder-quobyte-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c06e6f5-6e78-4dc5-90a9-2ace7c24ca3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37054de-8a5c-4db7-b58f-2c2a0c0dd2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Lock "cinder-quobyte-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d" acquired by "delete_volume" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Volume volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a (cc66f145-cd8b-4c15-bf2c-b93e83a9d71a): created successfully Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37054de-8a5c-4db7-b58f-2c2a0c0dd2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Flow 'volume_create_manager' (307cf537-df70-4caf-b09e-a005b8d1fa6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[596e4797-60b5-46e4-b4f2-8dc48669abab]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:31 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-be46e2b8-42b7-416a-bc95-a2d037b1da53 tempest-ProjectReaderTests-48003810 None] Created volume successfully. Jul 30 16:47:31 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d Jul 30 16:47:31 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:31 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d" returned: 0 in 0.455s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:31 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d Jul 30 16:47:31 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (4d2d1fc3-568b-42d6-96bf-93a0a5eb90e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88725473-0e01-4e55-a293-6fb329e98b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88725473-0e01-4e55-a293-6fb329e98b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272584554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949b1177-807a-472f-8e04-dfcd8aa4e0b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:32Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23031f18-18c7-49a8-87d7-6f6665b28486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23031f18-18c7-49a8-87d7-6f6665b28486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b999d3-51bb-4e0b-b529-0095628d79c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b999d3-51bb-4e0b-b529-0095628d79c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949b1177-807a-472f-8e04-dfcd8aa4e0b9', 'volume_name': 'volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cc63c9-67cf-44f2-8106-4391d470a065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cc63c9-67cf-44f2-8106-4391d470a065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbf1531-a3eb-4d36-99fe-12338909d71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:31 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Volume 949b1177-807a-472f-8e04-dfcd8aa4e0b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9', 'volume_size': 1} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272584554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949b1177-807a-472f-8e04-dfcd8aa4e0b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:32Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Creating volume 949b1177-807a-472f-8e04-dfcd8aa4e0b9 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:31 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:31 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:31 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 1073741824 Jul 30 16:47:31 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:32 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (c7d22e11-05f5-46e5-9963-ba0f6a07c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa2fc07-d3db-4ec1-9f53-36411ca3240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d" returned: 0 in 0.339s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa2fc07-d3db-4ec1-9f53-36411ca3240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837155172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0e4b29-dd06-4612-8bd4-6d3298c5705e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:32Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14ff185-85ae-4313-aedb-fe4f477992ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14ff185-85ae-4313-aedb-fe4f477992ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c238c06f-56e3-414b-ae30-3b5b3d38d61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c238c06f-56e3-414b-ae30-3b5b3d38d61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0e4b29-dd06-4612-8bd4-6d3298c5705e', 'volume_name': 'volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56763c8-5f81-4967-ae67-a7b799e965c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56763c8-5f81-4967-ae67-a7b799e965c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad7a083-79ac-4256-b42c-7542e100bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:32 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Volume 9f0e4b29-dd06-4612-8bd4-6d3298c5705e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e', 'volume_size': 1} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Lock "cinder-quobyte-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d" released by "delete_volume" :: held 0.881s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Created reservations ['f9abfbc4-ac23-49ec-84ef-e2adf03584c5', 'c83717c1-380c-4efd-96a8-bb37858712a9', 'f7d91c11-9183-4d7e-b483-0d6fb8229bbb', 'f11ae979-085d-4c6c-a135-b9fdaacdf61e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:32 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:32 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Acquiring lock "cinder-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Lock "cinder-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Acquiring lock "cinder-quobyte-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Lock "cinder-quobyte-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a" acquired by "delete_volume" :: waited 0.013s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:32 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 1073741824" returned: 0 in 0.486s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020269b-f4e3-416d-a173-8b86a2b9cd96]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:32 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 Jul 30 16:47:32 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:32 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.281s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Deleted volume successfully. Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-825af309-4749-476f-8858-459e5d5acce6 tempest-ProjectReaderTests-69934351 None] Lock "cinder-44e0e6e9-9e34-45ad-a4c6-5af47efc2a1d-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:32 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a Jul 30 16:47:32 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:32 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9" returned: 0 in 0.276s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.657s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837155172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0e4b29-dd06-4612-8bd4-6d3298c5705e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:32Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Creating volume 9f0e4b29-dd06-4612-8bd4-6d3298c5705e {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:32 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:32 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e 1073741824 Jul 30 16:47:32 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbf1531-a3eb-4d36-99fe-12338909d71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8cc3a1-b73e-4c8b-8c9d-c96185980aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:32 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Volume volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 (949b1177-807a-472f-8e04-dfcd8aa4e0b9): created successfully Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8cc3a1-b73e-4c8b-8c9d-c96185980aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:32 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (4d2d1fc3-568b-42d6-96bf-93a0a5eb90e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a" returned: 0 in 0.386s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:32 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:32 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d70422b8-f1ea-4460-9894-bca6fb3d294e tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:47:32 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a Jul 30 16:47:32 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a" returned: 0 in 0.258s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Lock "cinder-quobyte-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a" released by "delete_volume" :: held 0.685s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Created reservations ['09badd98-4f61-442d-9e72-a531eda138de', 'cf88fb26-2d5e-4018-a117-73c51235ac01', 'eb6c259e-a591-4134-853d-30c26b672773', '4fec573d-82a8-439e-9a55-635f953d494f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:33 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e 1073741824" returned: 0 in 0.497s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e Jul 30 16:47:33 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.277s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Deleted volume successfully. Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-3bad3b22-db74-43f9-ae20-b35ae3e47639 tempest-ProjectReaderTests-48003810 None] Lock "cinder-cc66f145-cd8b-4c15-bf2c-b93e83a9d71a-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:33 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad7a083-79ac-4256-b42c-7542e100bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93530886-32f6-43d0-a19b-21ad16e5a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Volume volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e (9f0e4b29-dd06-4612-8bd4-6d3298c5705e): created successfully Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93530886-32f6-43d0-a19b-21ad16e5a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (c7d22e11-05f5-46e5-9963-ba0f6a07c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:33 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-3a10f7e7-dda3-455f-bbb3-5d2b5e0216df tempest-ProjectReaderTests-1373598765 None] Created volume successfully. Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Flow 'volume_create_manager' (0cc306ff-5d12-432e-bae6-2bf16f6dae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2d2750-2688-4182-b30e-705e5063c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2d2750-2688-4182-b30e-705e5063c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564138987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8cfa7f-2bdd-4847-8255-e03d881e741e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8873ffc1824466babc021aed07d4711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:34Z,use_quota=True,user_id='c7a07b7434b34c4b8bc507a8fe55cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072b6e45-ac18-4dd0-bd17-bfa5964edce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072b6e45-ac18-4dd0-bd17-bfa5964edce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae936d3-56ac-4400-a7c0-3e6904d8fd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae936d3-56ac-4400-a7c0-3e6904d8fd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8cfa7f-2bdd-4847-8255-e03d881e741e', 'volume_name': 'volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae2e763-4d7c-47f5-983a-5a776fa76c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae2e763-4d7c-47f5-983a-5a776fa76c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db26db4-e0e8-49f3-a194-bd84fa55b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Volume 3c8cfa7f-2bdd-4847-8255-e03d881e741e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e', 'volume_size': 1} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564138987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8cfa7f-2bdd-4847-8255-e03d881e741e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8873ffc1824466babc021aed07d4711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:34Z,use_quota=True,user_id='c7a07b7434b34c4b8bc507a8fe55cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Creating volume 3c8cfa7f-2bdd-4847-8255-e03d881e741e {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:33 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:33 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e 1073741824 Jul 30 16:47:33 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:34 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e 1073741824" returned: 0 in 0.498s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:34 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e Jul 30 16:47:34 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:34 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e" returned: 0 in 0.261s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.751s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Creating offline snapshot 6c02e996-c443-43e1-96ec-1b65ed9870bc of volume 949b1177-807a-472f-8e04-dfcd8aa4e0b9 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db26db4-e0e8-49f3-a194-bd84fa55b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f367ae-499a-427b-bc39-c3ad80a6f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[954b1079-7c47-4f9f-a394-ae2af7976910]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:34 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Volume volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e (3c8cfa7f-2bdd-4847-8255-e03d881e741e): created successfully Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f367ae-499a-427b-bc39-c3ad80a6f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:34 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Flow 'volume_create_manager' (0cc306ff-5d12-432e-bae6-2bf16f6dae7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:34 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5421fc75-7e2d-467e-a42f-5051525b61e0 tempest-ProjectReaderTests-69934351 None] Created volume successfully. Jul 30 16:47:34 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 Jul 30 16:47:34 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:35 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9" returned: 0 in 0.375s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:35 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc 1G Jul 30 16:47:35 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:35 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc 1G" returned: 0 in 0.402s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:35 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc Jul 30 16:47:35 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:35 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc" returned: 0 in 0.318s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:35 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc is being set with open permissions: ugo+rw Jul 30 16:47:35 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:35 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc Jul 30 16:47:35 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:35 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Acquiring lock "cinder-3c8cfa7f-2bdd-4847-8255-e03d881e741e-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Lock "cinder-3c8cfa7f-2bdd-4847-8255-e03d881e741e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Acquiring lock "cinder-quobyte-3c8cfa7f-2bdd-4847-8255-e03d881e741e" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Lock "cinder-quobyte-3c8cfa7f-2bdd-4847-8255-e03d881e741e" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[820d3844-aade-405d-bca1-98e05744c01e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:36 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc" returned: 0 in 0.264s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:36 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e Jul 30 16:47:36 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:36 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.info Jul 30 16:47:36 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:36 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.info" returned: 0 in 0.247s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:36 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.info is being set with open permissions: ugo+rw Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:36 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e" returned: 0 in 0.354s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:36 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.info Jul 30 16:47:36 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:36 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e Jul 30 16:47:36 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:36 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.info" returned: 0 in 0.239s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:36 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.449s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3c8cfa7f-2bdd-4847-8255-e03d881e741e" returned: 0 in 0.250s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Creating offline snapshot 5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb of volume 9f0e4b29-dd06-4612-8bd4-6d3298c5705e {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Lock "cinder-quobyte-3c8cfa7f-2bdd-4847-8255-e03d881e741e" released by "delete_volume" :: held 0.659s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087ce63-d5cd-451f-8a23-7e8f608a2d43]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:36 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7f99b53d-4653-40a3-a9a9-42080d2162d1 tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Created reservations ['a10a62ff-c19c-4f9b-acd7-7c16d5bb9aaa', '658eecaf-aaf3-4a05-8447-f02ef185999c', '69936b93-eb2a-42c2-8571-8d69f5f0ca5e', 'dfe476c3-52c1-47c1-93fb-5f8437a8f273'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:36 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e Jul 30 16:47:36 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:36 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:36 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:36 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.262s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:37 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb 1G Jul 30 16:47:37 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Deleted volume successfully. Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-6c02e996-c443-43e1-96ec-1b65ed9870bc-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-b4cfb83b-2596-446f-84bf-1f27574dcafb tempest-ProjectReaderTests-69934351 None] Lock "cinder-3c8cfa7f-2bdd-4847-8255-e03d881e741e-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Lock "cinder-6c02e996-c443-43e1-96ec-1b65ed9870bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-949b1177-807a-472f-8e04-dfcd8aa4e0b9" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-949b1177-807a-472f-8e04-dfcd8aa4e0b9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-6c02e996-c443-43e1-96ec-1b65ed9870bc" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6c02e996-c443-43e1-96ec-1b65ed9870bc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot 6c02e996-c443-43e1-96ec-1b65ed9870bc of volume 949b1177-807a-472f-8e04-dfcd8aa4e0b9 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d9486-2ba0-4396-b07c-5c40c37bae44]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc Jul 30 16:47:37 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb 1G" returned: 0 in 0.470s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb Jul 30 16:47:37 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Flow 'volume_create_manager' (9a1d9464-fe01-4c64-b66b-8dbb392ebc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2276f2-6cc5-471e-a74c-cb7616fe6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2276f2-6cc5-471e-a74c-cb7616fe6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908040303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f240d0-e2cc-4c67-91d1-1a2b438c93c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8873ffc1824466babc021aed07d4711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:38Z,use_quota=True,user_id='c7a07b7434b34c4b8bc507a8fe55cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a604332-6a1a-4e80-b711-30d78abd953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a604332-6a1a-4e80-b711-30d78abd953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38cc4a47-3006-4aed-bcaf-fb25d031d8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38cc4a47-3006-4aed-bcaf-fb25d031d8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f240d0-e2cc-4c67-91d1-1a2b438c93c5', 'volume_name': 'volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:37 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3841e22-1ca8-475c-b5da-175ec4982b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3841e22-1ca8-475c-b5da-175ec4982b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46038465-80eb-4080-9840-f12ecab91278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:37 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Volume b9f240d0-e2cc-4c67-91d1-1a2b438c93c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5', 'volume_size': 1} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc" returned: 0 in 0.437s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d28b054-49f2-4320-a504-84c34be8b4d3]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 Jul 30 16:47:37 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb" returned: 0 in 0.297s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb is being set with open permissions: ugo+rw Jul 30 16:47:37 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb Jul 30 16:47:37 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:38 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9" returned: 0 in 0.357s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:38 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb" returned: 0 in 0.253s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:38 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc Jul 30 16:47:38 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:38 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.info Jul 30 16:47:38 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:38 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.info" returned: 0 in 0.253s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:38 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.info is being set with open permissions: ugo+rw Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:38 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.info Jul 30 16:47:38 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:38 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc" returned: 0 in 0.324s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:38 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc Jul 30 16:47:38 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:38 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.info" returned: 0 in 0.243s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908040303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f240d0-e2cc-4c67-91d1-1a2b438c93c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8873ffc1824466babc021aed07d4711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:38Z,use_quota=True,user_id='c7a07b7434b34c4b8bc507a8fe55cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Creating volume b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:38 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:38 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9.6c02e996-c443-43e1-96ec-1b65ed9870bc" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:38 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 1073741824 Jul 30 16:47:38 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-6c02e996-c443-43e1-96ec-1b65ed9870bc" released by "_delete_snapshot" :: held 1.515s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-1500c106-093b-456a-8d12-a92fce960965 tempest-ProjectReaderTests-1373598765 None] Create snapshot completed successfully Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-949b1177-807a-472f-8e04-dfcd8aa4e0b9" released by "delete_snapshot" :: held 1.547s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Created reservations ['8a79461b-fda6-4696-92d6-819fc0ef6fef', '7977a342-8f0e-4fb9-a1d7-b76d45dbb90d', '59abade3-efca-400a-87d0-de1d40be1ca0', '7cf10e7d-ec00-4292-a1d0-f5b02dd20633'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:38 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:47:38 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c03fa32d-74a2-464a-aba6-0e31fbcb3f25 tempest-ProjectMemberTests-402676597 None] Lock "cinder-6c02e996-c443-43e1-96ec-1b65ed9870bc-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:39 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 1073741824" returned: 0 in 0.409s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:39 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 Jul 30 16:47:39 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-949b1177-807a-472f-8e04-dfcd8aa4e0b9-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:39 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Lock "cinder-949b1177-807a-472f-8e04-dfcd8aa4e0b9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5" returned: 0 in 0.254s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46038465-80eb-4080-9840-f12ecab91278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad810d40-7db1-4c7c-a152-e04a9345b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:39 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Volume volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 (b9f240d0-e2cc-4c67-91d1-1a2b438c93c5): created successfully Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad810d40-7db1-4c7c-a152-e04a9345b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Flow 'volume_create_manager' (9a1d9464-fe01-4c64-b66b-8dbb392ebc50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-949b1177-807a-472f-8e04-dfcd8aa4e0b9" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-949b1177-807a-472f-8e04-dfcd8aa4e0b9" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:39 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7cea20bc-da16-4252-97b7-449816fca644 tempest-ProjectReaderTests-69934351 None] Created volume successfully. Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e5d0f-9661-4fb1-b8c4-64513a6b3895]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:39 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 Jul 30 16:47:39 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Acquiring lock "cinder-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Lock "cinder-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Acquiring lock "cinder-quobyte-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Lock "cinder-quobyte-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dbfe65-c8f2-4658-9491-9c423dbac287]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:39 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Deleting offline snapshot 5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb of volume 9f0e4b29-dd06-4612-8bd4-6d3298c5705e {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] snapshot_file for this snap is: volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad4d1a-c5ce-40ed-9625-749ec834402e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:40 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9" returned: 0 in 0.529s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:40 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9 Jul 30 16:47:40 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:40 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 Jul 30 16:47:40 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:40 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb Jul 30 16:47:40 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:40 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-949b1177-807a-472f-8e04-dfcd8aa4e0b9" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-949b1177-807a-472f-8e04-dfcd8aa4e0b9" released by "delete_volume" :: held 0.880s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:40 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5" returned: 0 in 0.435s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:40 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5 Jul 30 16:47:40 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:40 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb" returned: 0 in 0.396s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Created reservations ['3f5696bc-20fd-4cb0-a64e-fee40474e4c8', '67984403-579a-4dfe-89c2-8ed2667e5a46', 'bb3ed39f-72db-4e71-b3d6-dbe817f9eed8', '8b5a3497-4682-48b0-8adf-e6bedc72e73e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e33a63-8bcc-4daf-bb92-f6e4cf5e37da]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:40 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:40 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:40 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e Jul 30 16:47:40 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:40 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5" returned: 0 in 0.272s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Lock "cinder-quobyte-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5" released by "delete_volume" :: held 0.781s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Created reservations ['7f7db574-1d50-4deb-b73f-9f1911257158', 'fd0c6e97-f038-4f52-ba54-903cb35d14e0', '90fa98bb-bd6f-4ca9-b494-48e194d3462f', '44193d75-1199-471e-96ab-22c5ffe1686f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:40 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:40 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.294s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:40 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-9df496fc-3dcb-4d5a-9cc0-16133cd14024 tempest-ProjectMemberTests-402676597 None] Lock "cinder-949b1177-807a-472f-8e04-dfcd8aa4e0b9-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:40 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" returned: 0 in 0.429s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:40 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb Jul 30 16:47:40 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:41 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.297s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:41 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Deleted volume successfully. Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-d65b2835-5f37-4282-a9c5-75ba02ba306f tempest-ProjectReaderTests-69934351 None] Lock "cinder-b9f240d0-e2cc-4c67-91d1-1a2b438c93c5-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:41 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:41 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb Jul 30 16:47:41 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Flow 'volume_create_manager' (09b67a5b-44e8-450e-8238-68cb07465f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab908798-6f56-46f3-92d5-2388a8e735b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab908798-6f56-46f3-92d5-2388a8e735b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968021627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df16ef3-58d7-4c08-af61-14150f0add17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8873ffc1824466babc021aed07d4711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:41Z,use_quota=True,user_id='c7a07b7434b34c4b8bc507a8fe55cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0165e9-b37f-4680-b928-f1f64fb99eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0165e9-b37f-4680-b928-f1f64fb99eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db76a72-37cc-42eb-aeae-dcf52249d774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db76a72-37cc-42eb-aeae-dcf52249d774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df16ef3-58d7-4c08-af61-14150f0add17', 'volume_name': 'volume-5df16ef3-58d7-4c08-af61-14150f0add17', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce9ba1b-8da6-4d2d-9bea-41b11120528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce9ba1b-8da6-4d2d-9bea-41b11120528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c70ba1d-5e85-4ad8-ad27-aacb2b366302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:41 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Volume 5df16ef3-58d7-4c08-af61-14150f0add17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df16ef3-58d7-4c08-af61-14150f0add17', 'volume_size': 1} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968021627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df16ef3-58d7-4c08-af61-14150f0add17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8873ffc1824466babc021aed07d4711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:41Z,use_quota=True,user_id='c7a07b7434b34c4b8bc507a8fe55cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Creating volume 5df16ef3-58d7-4c08-af61-14150f0add17 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:41 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:41 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e.5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb" returned: 0 in 0.281s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:41 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 1073741824 Jul 30 16:47:41 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb" released by "_delete_snapshot" :: held 1.628s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" released by "delete_snapshot" :: held 1.656s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Created reservations ['adfe7ecf-2a2d-463c-9c7e-4a5bc1e33294', 'bc7d4066-8c68-4411-bf87-8580fb83dc74', 'af7d4be7-21d4-4ffc-aac2-10b1516fae1f', '83924732-2f8d-4ec2-8c25-3a5bdb6c95b4'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:41 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Delete snapshot completed successfully. Jul 30 16:47:41 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-56798c3f-ee56-49c4-97b5-c5ab30a4ee57 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-5e09cfa7-ba16-4c2a-9be4-e1d9338f34bb-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:42 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 1073741824" returned: 0 in 0.515s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-9f0e4b29-dd06-4612-8bd4-6d3298c5705e-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-9f0e4b29-dd06-4612-8bd4-6d3298c5705e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:42 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 Jul 30 16:47:42 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (eddc5cee-8182-4cf5-a2e0-f7123d2884af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e6e689-bddf-4947-b26d-769e2c21e3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e6e689-bddf-4947-b26d-769e2c21e3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678951817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228e3c2c-8ff5-404d-8a95-87939772cb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:42Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152540ef-1495-4f89-a937-d6a02a08edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152540ef-1495-4f89-a937-d6a02a08edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353ae3be-6ff3-42f1-9c30-04f856ec9280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353ae3be-6ff3-42f1-9c30-04f856ec9280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228e3c2c-8ff5-404d-8a95-87939772cb5d', 'volume_name': 'volume-228e3c2c-8ff5-404d-8a95-87939772cb5d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa435ba-8b28-43a2-b4fd-e535a1ff0e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa435ba-8b28-43a2-b4fd-e535a1ff0e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8e23b4-fc1a-4e7b-83f6-d8360e781d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Volume 228e3c2c-8ff5-404d-8a95-87939772cb5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228e3c2c-8ff5-404d-8a95-87939772cb5d', 'volume_size': 1} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3a5641-6c49-471e-8a13-8e3d50ad457b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:42 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17" returned: 0 in 0.263s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.162s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678951817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228e3c2c-8ff5-404d-8a95-87939772cb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:42Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Creating volume 228e3c2c-8ff5-404d-8a95-87939772cb5d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:42 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:42 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e Jul 30 16:47:42 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c70ba1d-5e85-4ad8-ad27-aacb2b366302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df16ef3-58d7-4c08-af61-14150f0add17', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d 1073741824 Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba38b142-c8b9-4c94-9d91-4006d2f582cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:42 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Volume volume-5df16ef3-58d7-4c08-af61-14150f0add17 (5df16ef3-58d7-4c08-af61-14150f0add17): created successfully Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba38b142-c8b9-4c94-9d91-4006d2f582cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Flow 'volume_create_manager' (09b67a5b-44e8-450e-8238-68cb07465f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:42 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-efc4dc7c-294a-4409-9144-56c3a4c5b178 tempest-ProjectReaderTests-69934351 None] Created volume successfully. Jul 30 16:47:42 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" returned: 0 in 0.390s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:42 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e Jul 30 16:47:42 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:42 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d 1073741824" returned: 0 in 0.486s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:42 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:42 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d Jul 30 16:47:42 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:42 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-9f0e4b29-dd06-4612-8bd4-6d3298c5705e" released by "delete_volume" :: held 0.725s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Created reservations ['4c671848-524c-426f-be37-bd6a493dffa7', '96636607-cf62-45c4-8aa9-4efc34449191', '3310d62e-d705-4241-bf24-710c17c28ce5', '6454f92d-cde1-4ca9-883d-3e05bae7a057'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:43 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:43 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:43 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d" returned: 0 in 0.268s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8e23b4-fc1a-4e7b-83f6-d8360e781d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228e3c2c-8ff5-404d-8a95-87939772cb5d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e536de8-eaf1-49de-9432-ac1dc054320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:43 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Volume volume-228e3c2c-8ff5-404d-8a95-87939772cb5d (228e3c2c-8ff5-404d-8a95-87939772cb5d): created successfully Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e536de8-eaf1-49de-9432-ac1dc054320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (eddc5cee-8182-4cf5-a2e0-f7123d2884af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-ce606a4e-2722-4696-84e0-4cb627a0e8ae tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:47:43 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.257s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:43 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Deleted volume successfully. Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-08480ab3-6243-4411-ad0a-870ebe1a1389 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-9f0e4b29-dd06-4612-8bd4-6d3298c5705e-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Acquiring lock "cinder-5df16ef3-58d7-4c08-af61-14150f0add17-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Lock "cinder-5df16ef3-58d7-4c08-af61-14150f0add17-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Acquiring lock "cinder-quobyte-5df16ef3-58d7-4c08-af61-14150f0add17" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Lock "cinder-quobyte-5df16ef3-58d7-4c08-af61-14150f0add17" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccc92b7-6f21-4ec5-8a50-53f3019444ec]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (dc8c067c-0278-46f8-a5a0-56f5f2f1a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b916ab50-15d9-4101-a95c-bc1c24ca0270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b916ab50-15d9-4101-a95c-bc1c24ca0270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1386031110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa958b8-8e0e-4732-9316-7b11070d854d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:44Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c96be8-dfc9-437e-afea-c185117708b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c96be8-dfc9-437e-afea-c185117708b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af5aba4-1deb-442c-8a64-786dc4b9c0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:43 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 Jul 30 16:47:43 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af5aba4-1deb-442c-8a64-786dc4b9c0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa958b8-8e0e-4732-9316-7b11070d854d', 'volume_name': 'volume-2fa958b8-8e0e-4732-9316-7b11070d854d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a612897e-81ce-40fb-830b-41315c33f903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a612897e-81ce-40fb-830b-41315c33f903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505bd21c-827e-4690-8c45-836f567df327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:43 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Volume 2fa958b8-8e0e-4732-9316-7b11070d854d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa958b8-8e0e-4732-9316-7b11070d854d', 'volume_size': 1} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1386031110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa958b8-8e0e-4732-9316-7b11070d854d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:44Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Creating volume 2fa958b8-8e0e-4732-9316-7b11070d854d {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:43 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:43 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:43 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d 1073741824 Jul 30 16:47:43 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:44 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17" returned: 0 in 0.404s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:44 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17 Jul 30 16:47:44 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:44 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d 1073741824" returned: 0 in 0.476s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:44 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-5df16ef3-58d7-4c08-af61-14150f0add17" returned: 0 in 0.265s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:44 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d Jul 30 16:47:44 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Lock "cinder-quobyte-5df16ef3-58d7-4c08-af61-14150f0add17" released by "delete_volume" :: held 0.716s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Created reservations ['4e99c592-ff68-48e2-8cc4-81f07dc7b7ec', '75379515-47c0-41fe-b1c3-6a2c7066d3ff', '7cd10dd3-4cae-455b-9a87-ca05e851d7cb', 'ba633610-b4f0-4f07-a3a9-527134316276'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:44 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:44 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:44 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d" returned: 0 in 0.261s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.288s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505bd21c-827e-4690-8c45-836f567df327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa958b8-8e0e-4732-9316-7b11070d854d', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f82a391-8549-4860-aa56-71224c52837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Creating offline snapshot f2a46b36-1e36-4796-85b7-d7e3b19c54d0 of volume 228e3c2c-8ff5-404d-8a95-87939772cb5d {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:44 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Volume volume-2fa958b8-8e0e-4732-9316-7b11070d854d (2fa958b8-8e0e-4732-9316-7b11070d854d): created successfully Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f82a391-8549-4860-aa56-71224c52837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (dc8c067c-0278-46f8-a5a0-56f5f2f1a405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f90dadb-1212-4b3f-aeee-81bf3da6fb24]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:44 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5e103104-942a-4dd1-8727-ed33c5aef1a5 tempest-ProjectReaderTests-1373598765 None] Created volume successfully. Jul 30 16:47:44 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.283s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:44 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Deleted volume successfully. Jul 30 16:47:44 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-dc974493-88b8-4935-8e70-70d7196196ff tempest-ProjectReaderTests-69934351 None] Lock "cinder-5df16ef3-58d7-4c08-af61-14150f0add17-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:44 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d Jul 30 16:47:44 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:45 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d" returned: 0 in 0.378s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:45 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 1G Jul 30 16:47:45 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:45 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 1G" returned: 0 in 0.403s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228e3c2c-8ff5-404d-8a95-87939772cb5d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:45 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228e3c2c-8ff5-404d-8a95-87939772cb5d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 Jul 30 16:47:45 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:45 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-228e3c2c-8ff5-404d-8a95-87939772cb5d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0" returned: 0 in 0.376s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:45 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 is being set with open permissions: ugo+rw Jul 30 16:47:45 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:45 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 Jul 30 16:47:45 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:46 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0" returned: 0 in 0.340s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:46 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.info Jul 30 16:47:46 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:46 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.info" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:46 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.info is being set with open permissions: ugo+rw Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:46 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.info Jul 30 16:47:46 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:46 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.info" returned: 0 in 0.248s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.714s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Creating offline snapshot 633aece5-6b79-4e4a-a75b-1bbdcc0a4036 of volume 2fa958b8-8e0e-4732-9316-7b11070d854d {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:46 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b7d6a541-cde9-4d32-965f-646b58eb6a15 tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[81149b0c-6fa5-48d9-9d5a-4af198849716]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:46 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:46 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d Jul 30 16:47:46 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:47 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d" returned: 0 in 0.338s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 1G Jul 30 16:47:47 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:47 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-f2a46b36-1e36-4796-85b7-d7e3b19c54d0-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Lock "cinder-f2a46b36-1e36-4796-85b7-d7e3b19c54d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-228e3c2c-8ff5-404d-8a95-87939772cb5d" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-228e3c2c-8ff5-404d-8a95-87939772cb5d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-f2a46b36-1e36-4796-85b7-d7e3b19c54d0" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-f2a46b36-1e36-4796-85b7-d7e3b19c54d0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot f2a46b36-1e36-4796-85b7-d7e3b19c54d0 of volume 228e3c2c-8ff5-404d-8a95-87939772cb5d {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0081f40b-2d12-479c-b7db-cb16a95609d2]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 1G" returned: 0 in 0.455s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa958b8-8e0e-4732-9316-7b11070d854d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa958b8-8e0e-4732-9316-7b11070d854d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 Jul 30 16:47:47 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:47 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.287s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:47:47 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 Jul 30 16:47:47 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:47 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa958b8-8e0e-4732-9316-7b11070d854d -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036" returned: 0 in 0.304s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:47 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 is being set with open permissions: ugo+rw Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 Jul 30 16:47:47 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:47 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0" returned: 0 in 0.368s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-228e3c2c-8ff5-404d-8a95-87939772cb5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be0cbd-1f52-40aa-bb39-48dab715ca8a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d Jul 30 16:47:48 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036" returned: 0 in 0.260s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.info Jul 30 16:47:48 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d" returned: 0 in 0.380s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 Jul 30 16:47:48 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.info" returned: 0 in 0.283s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.info is being set with open permissions: ugo+rw Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.info Jul 30 16:47:48 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.info" returned: 0 in 0.295s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0" returned: 0 in 0.443s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0 Jul 30 16:47:48 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-4397b4f1-27cc-465e-9375-cc3c6baea4d6 tempest-ProjectReaderTests-1373598765 None] Create snapshot completed successfully Jul 30 16:47:49 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d.f2a46b36-1e36-4796-85b7-d7e3b19c54d0" returned: 0 in 0.239s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-f2a46b36-1e36-4796-85b7-d7e3b19c54d0" released by "_delete_snapshot" :: held 1.519s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-228e3c2c-8ff5-404d-8a95-87939772cb5d" released by "delete_snapshot" :: held 1.548s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Created reservations ['124d6a03-88ed-45af-ab4c-52da5e61a7d9', '25447b21-5cad-4053-83dc-794832ff242d', '2f470ef7-d53a-4295-baff-cbf17fc104ea', '20d6883e-af44-4529-8902-ffad2ae222f2'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:49 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5a2b3133-694e-46a8-bcaa-4f27351ecc29 tempest-ProjectMemberTests-402676597 None] Lock "cinder-f2a46b36-1e36-4796-85b7-d7e3b19c54d0-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-633aece5-6b79-4e4a-a75b-1bbdcc0a4036-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Lock "cinder-633aece5-6b79-4e4a-a75b-1bbdcc0a4036-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-2fa958b8-8e0e-4732-9316-7b11070d854d" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-2fa958b8-8e0e-4732-9316-7b11070d854d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-633aece5-6b79-4e4a-a75b-1bbdcc0a4036" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-633aece5-6b79-4e4a-a75b-1bbdcc0a4036" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Deleting offline snapshot 633aece5-6b79-4e4a-a75b-1bbdcc0a4036 of volume 2fa958b8-8e0e-4732-9316-7b11070d854d {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] snapshot_file for this snap is: volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd9298a-43f0-424e-97c6-e8802b979e0b]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:49 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 Jul 30 16:47:49 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:49 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-228e3c2c-8ff5-404d-8a95-87939772cb5d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036" returned: 0 in 0.386s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fa958b8-8e0e-4732-9316-7b11070d854d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Lock "cinder-228e3c2c-8ff5-404d-8a95-87939772cb5d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e0b703-300a-4b47-823f-7e3134734c03]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-228e3c2c-8ff5-404d-8a95-87939772cb5d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-228e3c2c-8ff5-404d-8a95-87939772cb5d" acquired by "delete_volume" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee780ef3-b971-4b03-b0fc-8be2c4a2107f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:49 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:49 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d Jul 30 16:47:49 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:49 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d Jul 30 16:47:49 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:50 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:50 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 Jul 30 16:47:50 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:50 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d" returned: 0 in 0.369s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:50 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d Jul 30 16:47:50 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:50 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036" returned: 0 in 0.324s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:50 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:50 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036 Jul 30 16:47:50 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-228e3c2c-8ff5-404d-8a95-87939772cb5d" returned: 0 in 0.282s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-228e3c2c-8ff5-404d-8a95-87939772cb5d" released by "delete_volume" :: held 0.705s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Created reservations ['8a750ef2-1690-4c9e-bb52-f33612cd6134', '128af419-5df8-4722-8ef4-296f1d1f4149', '214f46a2-358a-4277-80a4-db49551939fc', 'dad1447b-f6d7-42fb-8db0-a6dbbd700b9d'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:50 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:50 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:50 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d.633aece5-6b79-4e4a-a75b-1bbdcc0a4036" returned: 0 in 0.266s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-633aece5-6b79-4e4a-a75b-1bbdcc0a4036" released by "_delete_snapshot" :: held 1.495s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-2fa958b8-8e0e-4732-9316-7b11070d854d" released by "delete_snapshot" :: held 1.526s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Created reservations ['73792e5c-ddc2-42cc-9310-1eb448bc3b99', 'c8df5f82-a21d-4cf3-b91f-646eea7758e1', '6098c2d8-2229-47e7-b79e-02c6b252ea13', '8a4d625f-8ebf-44b3-9935-5ed2914f168b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:50 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:47:50 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Delete snapshot completed successfully. Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c0d240f3-cecf-48bd-935e-1c446fd437c4 tempest-ProjectMemberTests-402676597 None] Lock "cinder-228e3c2c-8ff5-404d-8a95-87939772cb5d-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:50 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-fbe0fccb-0a55-4ae7-97f5-119a3c12482d tempest-ProjectReaderTests-1373598765 None] Lock "cinder-633aece5-6b79-4e4a-a75b-1bbdcc0a4036-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (7ff88987-87da-4785-8348-7741d8434a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00294bf-4e60-4154-9872-d4252595e2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00294bf-4e60-4154-9872-d4252595e2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83806147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9807b8-6f90-4847-9a87-03b24208175c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:51Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d80e3c2-f3df-43f0-b515-42c647453487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d80e3c2-f3df-43f0-b515-42c647453487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acafe17d-7db0-4447-b8ce-05d78ce506f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acafe17d-7db0-4447-b8ce-05d78ce506f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9807b8-6f90-4847-9a87-03b24208175c', 'volume_name': 'volume-0b9807b8-6f90-4847-9a87-03b24208175c', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65696c25-ccae-4ad2-bd52-f4cfea4d246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65696c25-ccae-4ad2-bd52-f4cfea4d246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d010f017-e5ae-4e84-bdc8-cdd9ab9b6713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:51 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Volume 0b9807b8-6f90-4847-9a87-03b24208175c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9807b8-6f90-4847-9a87-03b24208175c', 'volume_size': 1} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83806147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9807b8-6f90-4847-9a87-03b24208175c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:51Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Creating volume 0b9807b8-6f90-4847-9a87-03b24208175c {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:51 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-2fa958b8-8e0e-4732-9316-7b11070d854d-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:51 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c 1073741824 Jul 30 16:47:51 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Lock "cinder-2fa958b8-8e0e-4732-9316-7b11070d854d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-2fa958b8-8e0e-4732-9316-7b11070d854d" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-2fa958b8-8e0e-4732-9316-7b11070d854d" acquired by "delete_volume" :: waited 0.013s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4237d902-bd2f-42d5-8fd1-f26974177d0e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:51 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d Jul 30 16:47:51 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:51 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c 1073741824" returned: 0 in 0.425s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:51 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:51 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c Jul 30 16:47:51 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d" returned: 0 in 0.374s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:51 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:51 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d Jul 30 16:47:51 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:52 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c" returned: 0 in 0.240s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d010f017-e5ae-4e84-bdc8-cdd9ab9b6713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9807b8-6f90-4847-9a87-03b24208175c', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:52 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da01953-7377-4ce8-b0a1-b4f1fcb9a96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-2fa958b8-8e0e-4732-9316-7b11070d854d" returned: 0 in 0.243s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-2fa958b8-8e0e-4732-9316-7b11070d854d" released by "delete_volume" :: held 0.673s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:52 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Volume volume-0b9807b8-6f90-4847-9a87-03b24208175c (0b9807b8-6f90-4847-9a87-03b24208175c): created successfully Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da01953-7377-4ce8-b0a1-b4f1fcb9a96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (7ff88987-87da-4785-8348-7741d8434a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-97a1ef41-958f-4c67-b1fd-600ae513866a tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Created reservations ['8eac940f-4526-4742-bfe0-834a40d83d9d', '36df19f0-6aa6-4be6-a18f-a7ea65d2235e', '99999e52-3a1f-4cdf-bbf7-b33b7a5ccde0', 'e37ac95d-c51a-4f27-b5ae-0d1f6790d537'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:52 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:52 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Creating offline snapshot 356c8f8b-0339-4c30-ab9a-933eb7b43d90 of volume 0b9807b8-6f90-4847-9a87-03b24208175c {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:52 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76145dee-c2a2-4f6c-b149-1bb1ab3f8f45]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:52 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Deleted volume successfully. Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-05ff1709-ffc8-45bd-8b61-82ea592d73ee tempest-ProjectReaderTests-1373598765 None] Lock "cinder-2fa958b8-8e0e-4732-9316-7b11070d854d-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:52 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c Jul 30 16:47:52 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:52 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c" returned: 0 in 0.387s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:52 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 1G Jul 30 16:47:52 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (2dd73d0e-6267-47d0-93fe-2dcf2c3d2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca0d74d-afeb-4c5a-9ca9-08144bc99ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca0d74d-afeb-4c5a-9ca9-08144bc99ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284346998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfd4604-9269-4137-b893-4b891b61f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:53Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e2ffca-ee7d-4c30-b8b0-8acafb20effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e2ffca-ee7d-4c30-b8b0-8acafb20effe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbad8c49-d5f5-43e5-9941-41db52a11cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbad8c49-d5f5-43e5-9941-41db52a11cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cfd4604-9269-4137-b893-4b891b61f554', 'volume_name': 'volume-3cfd4604-9269-4137-b893-4b891b61f554', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8667e5ab-a3c5-42ba-ade9-d25528edc257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8667e5ab-a3c5-42ba-ade9-d25528edc257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a08101-98f6-48df-bfbe-232f0d10b50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Volume 3cfd4604-9269-4137-b893-4b891b61f554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cfd4604-9269-4137-b893-4b891b61f554', 'volume_size': 1} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:53 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 1G" returned: 0 in 0.389s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9807b8-6f90-4847-9a87-03b24208175c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:53 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9807b8-6f90-4847-9a87-03b24208175c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 Jul 30 16:47:53 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:53 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b9807b8-6f90-4847-9a87-03b24208175c -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90" returned: 0 in 0.296s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:53 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 is being set with open permissions: ugo+rw Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:53 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 Jul 30 16:47:53 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:53 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90" returned: 0 in 0.247s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:53 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.info Jul 30 16:47:53 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:54 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.info" returned: 0 in 0.245s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:54 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.info is being set with open permissions: ugo+rw Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:54 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.info Jul 30 16:47:54 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:54 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.info" returned: 0 in 0.234s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284346998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfd4604-9269-4137-b893-4b891b61f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:53Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Creating volume 3cfd4604-9269-4137-b893-4b891b61f554 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:54 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:54 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 1073741824 Jul 30 16:47:54 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:54 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a098abc9-2455-427c-848b-435694bb2486 tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-356c8f8b-0339-4c30-ab9a-933eb7b43d90-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-356c8f8b-0339-4c30-ab9a-933eb7b43d90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-0b9807b8-6f90-4847-9a87-03b24208175c" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-0b9807b8-6f90-4847-9a87-03b24208175c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-356c8f8b-0339-4c30-ab9a-933eb7b43d90" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-356c8f8b-0339-4c30-ab9a-933eb7b43d90" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot 356c8f8b-0339-4c30-ab9a-933eb7b43d90 of volume 0b9807b8-6f90-4847-9a87-03b24208175c {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccd3ccf-3fcf-4861-9f42-5a93ef39a850]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:54 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 Jul 30 16:47:54 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:54 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 1073741824" returned: 0 in 0.494s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:55 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 Jul 30 16:47:55 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:55 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90" returned: 0 in 0.400s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b9807b8-6f90-4847-9a87-03b24208175c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc00a726-d4ca-40bc-98f8-169567d222c1]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:55 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a08101-98f6-48df-bfbe-232f0d10b50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfd4604-9269-4137-b893-4b891b61f554', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85284cd3-3cb6-4150-afa6-72fb053a2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:55 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c Jul 30 16:47:55 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:55 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Volume volume-3cfd4604-9269-4137-b893-4b891b61f554 (3cfd4604-9269-4137-b893-4b891b61f554): created successfully Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85284cd3-3cb6-4150-afa6-72fb053a2131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (2dd73d0e-6267-47d0-93fe-2dcf2c3d2131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:55 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-91c6a276-69cc-4259-bdc4-ecb7daa0989d tempest-ProjectReaderTests-1373598765 None] Created volume successfully. Jul 30 16:47:55 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c" returned: 0 in 0.343s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:55 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 Jul 30 16:47:55 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:55 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90" returned: 0 in 0.322s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:55 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90 Jul 30 16:47:55 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:56 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c.356c8f8b-0339-4c30-ab9a-933eb7b43d90" returned: 0 in 0.234s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-356c8f8b-0339-4c30-ab9a-933eb7b43d90" released by "_delete_snapshot" :: held 1.385s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-0b9807b8-6f90-4847-9a87-03b24208175c" released by "delete_snapshot" :: held 1.411s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Created reservations ['daeec782-6fed-434e-9575-8c164d3d070d', 'a601e0b6-8e34-41a8-b52a-957b76227da5', '528b6f6b-2c8a-4e00-9579-4b68935edcee', '7ed0cf7d-1ddf-4d40-ac97-c3eca54a96e1'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-7bbd1c59-b517-4931-bbcc-be642313b5e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-356c8f8b-0339-4c30-ab9a-933eb7b43d90-delete_snapshot" released by "delete_snapshot" :: held 1.547s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Creating offline snapshot 0597ea74-f9d5-44d6-9166-fab84ead5d91 of volume 3cfd4604-9269-4137-b893-4b891b61f554 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c156c1-70e1-48d6-83ce-4d73a9da1431]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:56 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 Jul 30 16:47:56 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:56 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554" returned: 0 in 0.343s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:56 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 1G Jul 30 16:47:56 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-0b9807b8-6f90-4847-9a87-03b24208175c-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Lock "cinder-0b9807b8-6f90-4847-9a87-03b24208175c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-0b9807b8-6f90-4847-9a87-03b24208175c" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-0b9807b8-6f90-4847-9a87-03b24208175c" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7a1a3b-2885-43c0-841a-b031bdaf5c96]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:57 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c Jul 30 16:47:57 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:57 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 1G" returned: 0 in 0.392s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cfd4604-9269-4137-b893-4b891b61f554 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:57 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cfd4604-9269-4137-b893-4b891b61f554 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 Jul 30 16:47:57 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:57 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c" returned: 0 in 0.363s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:57 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c Jul 30 16:47:57 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:57 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cfd4604-9269-4137-b893-4b891b61f554 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91" returned: 0 in 0.282s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:57 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 is being set with open permissions: ugo+rw Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:57 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 Jul 30 16:47:57 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:57 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-0b9807b8-6f90-4847-9a87-03b24208175c" returned: 0 in 0.249s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-0b9807b8-6f90-4847-9a87-03b24208175c" released by "delete_volume" :: held 0.680s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Created reservations ['df02ceee-4e96-47d8-b1c9-f2008b1fcdc3', '2eaf1492-f38e-4771-ab84-3af34f99c403', 'c2b902a8-aee0-461d-9ea3-ceb4204848c1', 'b47c96eb-0a54-4c74-829b-a981d881ea39'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:57 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91" returned: 0 in 0.249s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:57 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.info Jul 30 16:47:57 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:57 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:47:57 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:57 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.info" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:57 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.info is being set with open permissions: ugo+rw Jul 30 16:47:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:57 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.info Jul 30 16:47:57 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:58 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a70c082c-c14f-4ddd-be8f-29b03fe1d45e tempest-ProjectMemberTests-402676597 None] Lock "cinder-0b9807b8-6f90-4847-9a87-03b24208175c-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:58 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.info" returned: 0 in 0.266s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:58 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f7a0a3d4-8f7e-4863-b51c-46503d450654 tempest-ProjectReaderTests-1373598765 None] Create snapshot completed successfully Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (0ecbdb0a-19be-4df5-b7dc-381275b89129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3d4bba-2c23-4719-aed4-7b246c08ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3d4bba-2c23-4719-aed4-7b246c08ea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785152272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:58Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafef1b5-279c-4581-8271-cfe49dcb6be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafef1b5-279c-4581-8271-cfe49dcb6be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72eb6a7-ec8a-4307-9fa7-d5e1a0e965a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72eb6a7-ec8a-4307-9fa7-d5e1a0e965a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e', 'volume_name': 'volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b61bba7-bdb5-41a8-a301-ee0dde577cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b61bba7-bdb5-41a8-a301-ee0dde577cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e0aec7-260e-41d8-9438-4d1bb0f7d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:58 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Volume d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e', 'volume_size': 1} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785152272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:58Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Creating volume d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:58 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-0597ea74-f9d5-44d6-9166-fab84ead5d91-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:58 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e 1073741824 Jul 30 16:47:58 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Lock "cinder-0597ea74-f9d5-44d6-9166-fab84ead5d91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-3cfd4604-9269-4137-b893-4b891b61f554" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-3cfd4604-9269-4137-b893-4b891b61f554" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-0597ea74-f9d5-44d6-9166-fab84ead5d91" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-0597ea74-f9d5-44d6-9166-fab84ead5d91" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Deleting offline snapshot 0597ea74-f9d5-44d6-9166-fab84ead5d91 of volume 3cfd4604-9269-4137-b893-4b891b61f554 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] snapshot_file for this snap is: volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[030dd0d8-3c31-4057-ab0d-754f4dbd0dfe]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:58 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 Jul 30 16:47:58 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:58 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e 1073741824" returned: 0 in 0.444s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:59 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91" returned: 0 in 0.374s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cfd4604-9269-4137-b893-4b891b61f554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9b1440-c2a8-423a-aec5-6ac3937d8f85]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:59 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e Jul 30 16:47:59 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:59 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 Jul 30 16:47:59 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:59 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" returned: 0 in 0.243s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e0aec7-260e-41d8-9438-4d1bb0f7d67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309e9217-88cb-4bcb-9aaa-8c643221750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:59 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Volume volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e (d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e): created successfully Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309e9217-88cb-4bcb-9aaa-8c643221750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (0ecbdb0a-19be-4df5-b7dc-381275b89129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:59 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2ef76a39-287c-4f8c-b8d3-4459ecbc35e7 tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:47:59 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:59 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 Jul 30 16:47:59 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Creating offline snapshot 01b569b9-c153-4eec-89c4-2bdc1534d91a of volume d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a5ab9a-9082-4c25-bf85-feaea400031a]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:59 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91" returned: 0 in 0.353s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:59 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:59 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91 Jul 30 16:47:59 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:59 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e Jul 30 16:47:59 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:00 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554.0597ea74-f9d5-44d6-9166-fab84ead5d91" returned: 0 in 0.261s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-0597ea74-f9d5-44d6-9166-fab84ead5d91" released by "_delete_snapshot" :: held 1.455s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-3cfd4604-9269-4137-b893-4b891b61f554" released by "delete_snapshot" :: held 1.476s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:00 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" returned: 0 in 0.378s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:00 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a 1G Jul 30 16:48:00 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Created reservations ['1e84eda2-46b6-46c1-9fb0-bc72488d87ac', '9cdec65c-a5e0-43a3-8f9f-b6bd8fcb6f59', 'b888adf1-e41a-48b0-bca4-0e0d74a07975', 'fb16ffa2-a222-44b8-9c4a-a7be15aab03f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:00 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Delete snapshot completed successfully. Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c64fef1a-3110-4a13-8fa2-57620db4e4df tempest-ProjectReaderTests-1373598765 None] Lock "cinder-0597ea74-f9d5-44d6-9166-fab84ead5d91-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:00 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a 1G" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:00 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a Jul 30 16:48:00 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-3cfd4604-9269-4137-b893-4b891b61f554-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-3cfd4604-9269-4137-b893-4b891b61f554-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-3cfd4604-9269-4137-b893-4b891b61f554" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-3cfd4604-9269-4137-b893-4b891b61f554" acquired by "delete_volume" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9d3ad0-1540-4507-bf5d-80f767453abf]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:00 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a" returned: 0 in 0.343s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:00 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a is being set with open permissions: ugo+rw Jul 30 16:48:00 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:00 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a Jul 30 16:48:00 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:00 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 Jul 30 16:48:00 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:01 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a" returned: 0 in 0.242s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:01 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.info Jul 30 16:48:01 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:01 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:01 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554 Jul 30 16:48:01 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:01 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.info" returned: 0 in 0.283s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.info is being set with open permissions: ugo+rw Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:01 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.info Jul 30 16:48:01 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:01 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3cfd4604-9269-4137-b893-4b891b61f554" returned: 0 in 0.252s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-3cfd4604-9269-4137-b893-4b891b61f554" released by "delete_volume" :: held 0.696s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Created reservations ['af85316e-676b-4f26-b129-d492d3211c3f', 'dd89661a-7c67-4887-bf2e-950295924b37', 'c2f815eb-d3c7-46e7-9798-6554f8f6fd04', 'ab8a5f19-d3b7-4bea-aa38-4717e94a0c09'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:01 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:48:01 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:01 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.info" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a9cc4219-07ec-4eab-b242-563cedbd17be tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-01b569b9-c153-4eec-89c4-2bdc1534d91a-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:01 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.273s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:01 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Deleted volume successfully. Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Lock "cinder-01b569b9-c153-4eec-89c4-2bdc1534d91a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-01b569b9-c153-4eec-89c4-2bdc1534d91a" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-62b350ff-f19c-457d-90d0-4e1a15a52618 tempest-ProjectReaderTests-1373598765 None] Lock "cinder-3cfd4604-9269-4137-b893-4b891b61f554-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-01b569b9-c153-4eec-89c4-2bdc1534d91a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot 01b569b9-c153-4eec-89c4-2bdc1534d91a of volume d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a514b19c-fa16-4254-8d6a-5e6b07eb32ad]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:01 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:02 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a Jul 30 16:48:02 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (ba7cc60a-dc52-4715-ab39-9ca23fd41aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02bc8327-454a-413d-8583-fb24e7f15345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:02 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a" returned: 0 in 0.413s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02bc8327-454a-413d-8583-fb24e7f15345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076527356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b3a343-8d18-4254-9b48-b463ec456460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:02Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9a6a6e-be9f-43ed-978b-ca29fa090b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9a6a6e-be9f-43ed-978b-ca29fa090b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fc083a-c8fe-4ebc-aead-0add261a69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fc083a-c8fe-4ebc-aead-0add261a69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b3a343-8d18-4254-9b48-b463ec456460', 'volume_name': 'volume-a9b3a343-8d18-4254-9b48-b463ec456460', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426ec60e-aac8-4213-90b1-7a3277ac1516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426ec60e-aac8-4213-90b1-7a3277ac1516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebf6df6-1307-4057-9d5d-ec95e0e53286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:02 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Volume a9b3a343-8d18-4254-9b48-b463ec456460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b3a343-8d18-4254-9b48-b463ec456460', 'volume_size': 1} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076527356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b3a343-8d18-4254-9b48-b463ec456460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:02Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Creating volume a9b3a343-8d18-4254-9b48-b463ec456460 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:02 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[433047ed-4634-44da-bee1-ca389a797e39]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:02 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 1073741824 Jul 30 16:48:02 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:02 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e Jul 30 16:48:02 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:02 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" returned: 0 in 0.420s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:02 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 1073741824" returned: 0 in 0.451s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:02 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a Jul 30 16:48:02 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:03 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 Jul 30 16:48:03 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:03 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a" returned: 0 in 0.380s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:03 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:03 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a Jul 30 16:48:03 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460" returned: 0 in 0.258s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebf6df6-1307-4057-9d5d-ec95e0e53286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b3a343-8d18-4254-9b48-b463ec456460', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b18b1b-7f89-4b78-a238-9f5e8330867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:03 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Volume volume-a9b3a343-8d18-4254-9b48-b463ec456460 (a9b3a343-8d18-4254-9b48-b463ec456460): created successfully Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b18b1b-7f89-4b78-a238-9f5e8330867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (ba7cc60a-dc52-4715-ab39-9ca23fd41aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:03 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-695d5091-e423-44a7-ba6e-6c8df62fadda tempest-ProjectReaderTests-1373598765 None] Created volume successfully. Jul 30 16:48:03 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e.01b569b9-c153-4eec-89c4-2bdc1534d91a" returned: 0 in 0.270s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-01b569b9-c153-4eec-89c4-2bdc1534d91a" released by "_delete_snapshot" :: held 1.636s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" released by "delete_snapshot" :: held 1.667s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Created reservations ['0d1895e6-4f66-49fd-92f9-faac9643d7d2', '0b210d83-af7f-4614-a566-22ca8096b00a', 'f37c2a5d-0e01-468b-bdfa-4407cdebaf3d', '07b6f508-49ea-47fb-a8b0-ae73308c671b'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:03 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:48:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-a949ba00-108d-48ba-8935-2a9352566e42 tempest-ProjectMemberTests-402676597 None] Lock "cinder-01b569b9-c153-4eec-89c4-2bdc1534d91a-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Lock "cinder-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" acquired by "delete_volume" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5c3f0e-6433-4ec3-b30c-6a281f234c23]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:04 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e Jul 30 16:48:04 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:04 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" returned: 0 in 0.378s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:04 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e Jul 30 16:48:04 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Creating offline snapshot c9dec723-12c9-484b-b574-feb01191577f of volume a9b3a343-8d18-4254-9b48-b463ec456460 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[69952a49-6089-43db-8cfe-64a7245b680f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:04 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 Jul 30 16:48:04 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:04 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" returned: 0 in 0.275s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e" released by "delete_volume" :: held 0.719s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Created reservations ['cb157bf0-887c-4c11-85d0-0c1ebd8cf72e', '763b4ec5-3b70-474e-b2d4-c8c3d208ca75', '0865fc71-a80e-4586-b06a-8d1c55a0d090', 'bf07a098-6a57-4890-86ab-f2306cb9fc72'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:04 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:48:04 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:05 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460" returned: 0 in 0.393s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:05 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f 1G Jul 30 16:48:05 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:05 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.263s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:05 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f4c8c320-a29a-4394-8090-4db5f248bd0a tempest-ProjectMemberTests-402676597 None] Lock "cinder-d1f4a5d3-ce74-4dbe-8ce9-bd45e3ba5c4e-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:05 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f 1G" returned: 0 in 0.434s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b3a343-8d18-4254-9b48-b463ec456460 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:05 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b3a343-8d18-4254-9b48-b463ec456460 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f Jul 30 16:48:05 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (0ddebfd1-c568-418a-a5f0-bd3bdbb5f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50183eac-effb-42df-a76f-93cb977093ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50183eac-effb-42df-a76f-93cb977093ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576081152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c02e98-be35-4990-81a8-d99dd2a0ebc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:06Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4337de4a-4fa2-4e3e-8a63-7aee6e1ffbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4337de4a-4fa2-4e3e-8a63-7aee6e1ffbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b86911-1335-412c-bc2a-7fae9c7fe796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b86911-1335-412c-bc2a-7fae9c7fe796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c02e98-be35-4990-81a8-d99dd2a0ebc3', 'volume_name': 'volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:05 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b38c35d-9fa1-47fc-b6c6-a93c9ed3b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b38c35d-9fa1-47fc-b6c6-a93c9ed3b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3004ef96-9c37-4990-bf80-60051f60a553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:05 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Volume 07c02e98-be35-4990-81a8-d99dd2a0ebc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3', 'volume_size': 1} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b3a343-8d18-4254-9b48-b463ec456460 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f" returned: 0 in 0.321s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:05 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f is being set with open permissions: ugo+rw Jul 30 16:48:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:05 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f Jul 30 16:48:05 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:06 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f" returned: 0 in 0.232s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:06 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.info Jul 30 16:48:06 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:06 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.info" returned: 0 in 0.239s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:06 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.info is being set with open permissions: ugo+rw Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:06 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.info Jul 30 16:48:06 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:06 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.info" returned: 0 in 0.229s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576081152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c02e98-be35-4990-81a8-d99dd2a0ebc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:06Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Creating volume 07c02e98-be35-4990-81a8-d99dd2a0ebc3 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:06 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:06 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 1073741824 Jul 30 16:48:06 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:06 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-b631d0d9-30c3-4b78-9699-927ff2bcfe56 tempest-ProjectReaderTests-1373598765 None] Create snapshot completed successfully Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-c9dec723-12c9-484b-b574-feb01191577f-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Lock "cinder-c9dec723-12c9-484b-b574-feb01191577f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-a9b3a343-8d18-4254-9b48-b463ec456460" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-a9b3a343-8d18-4254-9b48-b463ec456460" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-c9dec723-12c9-484b-b574-feb01191577f" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-c9dec723-12c9-484b-b574-feb01191577f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Deleting offline snapshot c9dec723-12c9-484b-b574-feb01191577f of volume a9b3a343-8d18-4254-9b48-b463ec456460 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] snapshot_file for this snap is: volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[994175d4-6679-4d7f-86f5-c84970182bce]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:06 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f Jul 30 16:48:06 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:06 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 1073741824" returned: 0 in 0.427s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:07 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 Jul 30 16:48:07 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:07 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b3a343-8d18-4254-9b48-b463ec456460(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7172e7-cff3-4276-89a9-7e599cfa5b2f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:07 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3" returned: 0 in 0.245s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3004ef96-9c37-4990-bf80-60051f60a553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9214f933-83d3-4e4c-a78c-553ee3395754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:07 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Volume volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 (07c02e98-be35-4990-81a8-d99dd2a0ebc3): created successfully Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9214f933-83d3-4e4c-a78c-553ee3395754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (0ddebfd1-c568-418a-a5f0-bd3bdbb5f173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-37522c7a-80a8-462f-8483-cece6d10c5d4 tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:48:07 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 Jul 30 16:48:07 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:07 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460" returned: 0 in 0.359s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:07 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f Jul 30 16:48:07 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Creating offline snapshot 0056d4c8-e01e-4aa9-83bd-65132d74e73f of volume 07c02e98-be35-4990-81a8-d99dd2a0ebc3 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3421993-dfc4-48ef-9276-25bc7616e35f]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:07 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f" returned: 0 in 0.384s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:07 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f Jul 30 16:48:07 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:08 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 Jul 30 16:48:08 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:08 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460.c9dec723-12c9-484b-b574-feb01191577f" returned: 0 in 0.250s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-c9dec723-12c9-484b-b574-feb01191577f" released by "_delete_snapshot" :: held 1.451s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-a9b3a343-8d18-4254-9b48-b463ec456460" released by "delete_snapshot" :: held 1.474s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Created reservations ['469792b0-d15c-40f6-8d72-45e2ba883c98', '6c730415-c863-4bec-a86f-bf74584d8dec', '7d6f632d-9304-49d0-b1f1-db4c83696640', 'be2ea457-ae58-4eb2-93e8-33958187f0f6'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:08 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3" returned: 0 in 0.370s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:08 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f 1G Jul 30 16:48:08 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:08 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Delete snapshot completed successfully. Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-8d8d9e38-3eae-4aea-9716-45b9309382ca tempest-ProjectReaderTests-1373598765 None] Lock "cinder-c9dec723-12c9-484b-b574-feb01191577f-delete_snapshot" released by "delete_snapshot" :: held 1.643s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:08 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f 1G" returned: 0 in 0.379s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:08 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f Jul 30 16:48:08 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-a9b3a343-8d18-4254-9b48-b463ec456460-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Lock "cinder-a9b3a343-8d18-4254-9b48-b463ec456460-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-a9b3a343-8d18-4254-9b48-b463ec456460" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:08 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-a9b3a343-8d18-4254-9b48-b463ec456460" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8779e21a-7ddb-4ab0-b472-f507c53f0bf3]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:09 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f" returned: 0 in 0.334s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:09 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f is being set with open permissions: ugo+rw Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:09 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f Jul 30 16:48:09 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:09 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 Jul 30 16:48:09 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:09 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f" returned: 0 in 0.242s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:09 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.info Jul 30 16:48:09 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:09 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:09 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460 Jul 30 16:48:09 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:09 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.info" returned: 0 in 0.263s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:09 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.info is being set with open permissions: ugo+rw Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:09 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.info Jul 30 16:48:09 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:09 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a9b3a343-8d18-4254-9b48-b463ec456460" returned: 0 in 0.252s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-a9b3a343-8d18-4254-9b48-b463ec456460" released by "delete_volume" :: held 0.677s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Created reservations ['88c5d814-cf35-4d76-9a77-7de778066dc6', '22d55535-6ea2-41dd-b639-f2fefe7c59f5', 'edbee71c-0bd1-4a58-a001-e978401b75a1', '83c75fe2-3184-4675-a891-fe96e3aee2bd'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:09 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:48:09 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:09 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.info" returned: 0 in 0.267s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:09 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:09 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-40140008-8eab-405e-aee8-40ade0d8b6bb tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:48:10 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.272s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:10 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Deleted volume successfully. Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-0056d4c8-e01e-4aa9-83bd-65132d74e73f-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-6e3e8fa7-cc1e-44e5-a975-281c166ffcee tempest-ProjectReaderTests-1373598765 None] Lock "cinder-a9b3a343-8d18-4254-9b48-b463ec456460-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Lock "cinder-0056d4c8-e01e-4aa9-83bd-65132d74e73f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-07c02e98-be35-4990-81a8-d99dd2a0ebc3" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-07c02e98-be35-4990-81a8-d99dd2a0ebc3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-0056d4c8-e01e-4aa9-83bd-65132d74e73f" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-0056d4c8-e01e-4aa9-83bd-65132d74e73f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot 0056d4c8-e01e-4aa9-83bd-65132d74e73f of volume 07c02e98-be35-4990-81a8-d99dd2a0ebc3 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[43922bff-53e1-46f7-8969-0f0b444f2d48]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:10 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f Jul 30 16:48:10 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (73f370b6-8067-41b7-a241-4f004d637a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6215e560-bb73-44f6-b5f4-e1b7af9d2588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:10 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6215e560-bb73-44f6-b5f4-e1b7af9d2588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568306359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8d98c4-63f5-4100-ab89-3879a8eed4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:11Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432a081a-63e4-40c6-a014-74e1d93c4516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432a081a-63e4-40c6-a014-74e1d93c4516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7829691c-2d57-464d-bf06-26970c50edbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7829691c-2d57-464d-bf06-26970c50edbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8d98c4-63f5-4100-ab89-3879a8eed4ec', 'volume_name': 'volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688a7b80-08f2-4e73-9867-de78531cbd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688a7b80-08f2-4e73-9867-de78531cbd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74f6789-601c-43bb-bf26-e10b2deb43e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:10 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Volume 3b8d98c4-63f5-4100-ab89-3879a8eed4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec', 'volume_size': 1} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568306359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8d98c4-63f5-4100-ab89-3879a8eed4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21365fd569040a49b4e5145459c94ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:11Z,use_quota=True,user_id='56c890b2eb9145b3b8a2d9335e8e3090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Creating volume 3b8d98c4-63f5-4100-ab89-3879a8eed4ec {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:10 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f" returned: 0 in 0.452s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:10 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec 1073741824 Jul 30 16:48:10 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbb4ce3-8dcf-47d1-8226-e150971a9b95]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:10 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:10 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 Jul 30 16:48:10 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:11 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3" returned: 0 in 0.371s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:11 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec 1073741824" returned: 0 in 0.439s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:11 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f Jul 30 16:48:11 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:11 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec Jul 30 16:48:11 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:11 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" returned: 0 in 0.244s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74f6789-601c-43bb-bf26-e10b2deb43e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff92f63e-0876-44df-942d-5a0b8dea7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:11 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Volume volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec (3b8d98c4-63f5-4100-ab89-3879a8eed4ec): created successfully Jul 30 16:48:11 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff92f63e-0876-44df-942d-5a0b8dea7357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Flow 'volume_create_manager' (73f370b6-8067-41b7-a241-4f004d637a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f" returned: 0 in 0.347s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-fceb70a5-5efc-4555-bfd2-1e16e7f0e1db tempest-ProjectReaderTests-1373598765 None] Created volume successfully. Jul 30 16:48:11 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f Jul 30 16:48:11 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:11 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3.0056d4c8-e01e-4aa9-83bd-65132d74e73f" returned: 0 in 0.261s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-0056d4c8-e01e-4aa9-83bd-65132d74e73f" released by "_delete_snapshot" :: held 1.558s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-07c02e98-be35-4990-81a8-d99dd2a0ebc3" released by "delete_snapshot" :: held 1.582s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Creating offline snapshot 05abcc92-dafc-4a75-8363-1b836768019e of volume 3b8d98c4-63f5-4100-ab89-3879a8eed4ec {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c41c0b-b058-4531-9895-8baec8542475]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Created reservations ['8d281491-1880-459b-80ef-3e636cde7aa8', '91db884e-5e99-4a80-a96c-43c4d7608456', '8a75cb91-2932-4097-9b22-cc71be5daca6', 'fa2eb11c-8d03-4c2e-9707-57a447faa263'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:11 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:48:11 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec Jul 30 16:48:11 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:11 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-0df8b2a7-a8ce-443c-8e9b-bd729bf80301 tempest-ProjectMemberTests-402676597 None] Lock "cinder-0056d4c8-e01e-4aa9-83bd-65132d74e73f-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:12 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" returned: 0 in 0.358s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:12 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e 1G Jul 30 16:48:12 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-07c02e98-be35-4990-81a8-d99dd2a0ebc3-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Lock "cinder-07c02e98-be35-4990-81a8-d99dd2a0ebc3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-07c02e98-be35-4990-81a8-d99dd2a0ebc3" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-07c02e98-be35-4990-81a8-d99dd2a0ebc3" acquired by "delete_volume" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f67ca2d-1345-41e9-925b-f16bbf93d2c0]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:12 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 Jul 30 16:48:12 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:12 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e 1G" returned: 0 in 0.415s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:12 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e Jul 30 16:48:12 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:12 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3" returned: 0 in 0.429s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:12 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3 Jul 30 16:48:12 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:12 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e" returned: 0 in 0.327s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:12 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e is being set with open permissions: ugo+rw Jul 30 16:48:12 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:12 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e Jul 30 16:48:12 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:13 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-07c02e98-be35-4990-81a8-d99dd2a0ebc3" returned: 0 in 0.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-07c02e98-be35-4990-81a8-d99dd2a0ebc3" released by "delete_volume" :: held 0.732s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Created reservations ['2e6761c3-0934-4939-8127-4e202bda0f75', '35fcc485-a37c-4c00-8d7f-e3512ec1f68a', '43c83c08-c91b-451e-8b43-6693bda3f6db', '016fa074-4ab3-4544-b8f4-d46db71ae929'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:13 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e" returned: 0 in 0.256s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:13 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.info Jul 30 16:48:13 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:13 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:48:13 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:13 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.info" returned: 0 in 0.285s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:13 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.info is being set with open permissions: ugo+rw Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:13 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.265s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:13 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.info Jul 30 16:48:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:48:13 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-f0041423-ecbc-4178-bfac-cc2d84c2ed34 tempest-ProjectMemberTests-402676597 None] Lock "cinder-07c02e98-be35-4990-81a8-d99dd2a0ebc3-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:13 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.info" returned: 0 in 0.280s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:13 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-bf9c75d1-8832-4cbe-b97a-691eeadab33f tempest-ProjectReaderTests-1373598765 None] Create snapshot completed successfully Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (4ce16a40-7dc8-4f58-91e8-3b9c1e294e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d4a55c-bace-419b-a99b-78dd9c9daabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d4a55c-bace-419b-a99b-78dd9c9daabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1431253783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754c70a3-aa47-4c70-813d-dee010624963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:14Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9f7007-c818-4ea8-bcac-e45d7fe8aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9f7007-c818-4ea8-bcac-e45d7fe8aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d63fbda-e257-44fc-9b5c-328508c36725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d63fbda-e257-44fc-9b5c-328508c36725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '754c70a3-aa47-4c70-813d-dee010624963', 'volume_name': 'volume-754c70a3-aa47-4c70-813d-dee010624963', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b215ce5c-a173-44fc-b2da-b8ed51a37324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b215ce5c-a173-44fc-b2da-b8ed51a37324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c885b41-f34a-485f-9ce3-23ac5f53a205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:13 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Volume 754c70a3-aa47-4c70-813d-dee010624963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-754c70a3-aa47-4c70-813d-dee010624963', 'volume_size': 1} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1431253783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754c70a3-aa47-4c70-813d-dee010624963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9620d3d8e7cb41f4804ddc58cf80ad6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:14Z,use_quota=True,user_id='7090998cff464b00b5622eaefc7089f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Creating volume 754c70a3-aa47-4c70-813d-dee010624963 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:13 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:48:13 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:14 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 1073741824 Jul 30 16:48:14 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:14 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 1073741824" returned: 0 in 0.417s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:14 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 Jul 30 16:48:14 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:14 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963" returned: 0 in 0.237s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c885b41-f34a-485f-9ce3-23ac5f53a205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-754c70a3-aa47-4c70-813d-dee010624963', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1451be-de19-4e9e-bd3c-ecf66eedd3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:14 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Volume volume-754c70a3-aa47-4c70-813d-dee010624963 (754c70a3-aa47-4c70-813d-dee010624963): created successfully Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1451be-de19-4e9e-bd3c-ecf66eedd3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Flow 'volume_create_manager' (4ce16a40-7dc8-4f58-91e8-3b9c1e294e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:14 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-9aaa4612-f625-4f2e-8202-832da1351614 tempest-ProjectMemberTests-402676597 None] Created volume successfully. Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-05abcc92-dafc-4a75-8363-1b836768019e-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Lock "cinder-05abcc92-dafc-4a75-8363-1b836768019e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-05abcc92-dafc-4a75-8363-1b836768019e" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-05abcc92-dafc-4a75-8363-1b836768019e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:14 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Deleting offline snapshot 05abcc92-dafc-4a75-8363-1b836768019e of volume 3b8d98c4-63f5-4100-ab89-3879a8eed4ec {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] snapshot_file for this snap is: volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b95957-e148-40f4-89ec-8c75b9a8df90]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Creating offline snapshot f1804939-7856-439b-a953-332264ae12db of volume 754c70a3-aa47-4c70-813d-dee010624963 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f04daa9-6e0f-48fa-bd4c-1e1c54c2571d]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:15 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e Jul 30 16:48:15 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:15 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 Jul 30 16:48:15 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:15 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e" returned: 0 in 0.385s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[492a1222-156b-4901-ad1c-1dd91956a0c8]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:15 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963" returned: 0 in 0.374s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:15 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec Jul 30 16:48:15 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:15 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db 1G Jul 30 16:48:15 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:15 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" returned: 0 in 0.358s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:15 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e Jul 30 16:48:15 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:15 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db 1G" returned: 0 in 0.418s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:15 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-754c70a3-aa47-4c70-813d-dee010624963 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:15 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-754c70a3-aa47-4c70-813d-dee010624963 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db Jul 30 16:48:15 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:16 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e" returned: 0 in 0.324s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:16 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e Jul 30 16:48:16 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:16 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-754c70a3-aa47-4c70-813d-dee010624963 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db" returned: 0 in 0.305s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:16 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db is being set with open permissions: ugo+rw Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:16 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db Jul 30 16:48:16 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:16 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec.05abcc92-dafc-4a75-8363-1b836768019e" returned: 0 in 0.269s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-05abcc92-dafc-4a75-8363-1b836768019e" released by "_delete_snapshot" :: held 1.439s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" released by "delete_snapshot" :: held 1.466s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Created reservations ['f2504d5f-0e60-4968-9bbc-7b626b796d5d', '97007920-0913-4761-a108-5f58228bb859', '37b0b2f3-2d03-466f-b1a1-ec416903f313', '48d0c614-cb51-411d-b866-5e709d6780d4'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:16 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db" returned: 0 in 0.291s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:16 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Delete snapshot completed successfully. Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-cd279176-12ba-4891-bd25-e10a49652e2c tempest-ProjectReaderTests-1373598765 None] Lock "cinder-05abcc92-dafc-4a75-8363-1b836768019e-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:16 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.info Jul 30 16:48:16 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:16 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.info" returned: 0 in 0.255s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:16 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.info is being set with open permissions: ugo+rw Jul 30 16:48:16 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:16 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.info Jul 30 16:48:16 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:17 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.info" returned: 0 in 0.242s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-3b8d98c4-63f5-4100-ab89-3879a8eed4ec-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:17 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-999e6800-b25e-475c-9ec6-9535d4950c6b tempest-ProjectMemberTests-402676597 None] Create snapshot completed successfully Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Lock "cinder-3b8d98c4-63f5-4100-ab89-3879a8eed4ec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Acquiring lock "cinder-quobyte-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1af4b5d-4cf4-4018-8f6e-e6780e7467bf]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:17 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec Jul 30 16:48:17 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-f1804939-7856-439b-a953-332264ae12db-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-f1804939-7856-439b-a953-332264ae12db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-754c70a3-aa47-4c70-813d-dee010624963" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-754c70a3-aa47-4c70-813d-dee010624963" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-f1804939-7856-439b-a953-332264ae12db" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-f1804939-7856-439b-a953-332264ae12db" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Deleting offline snapshot f1804939-7856-439b-a953-332264ae12db of volume 754c70a3-aa47-4c70-813d-dee010624963 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] snapshot_file for this snap is: volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb4d45-b03b-43f6-aba9-d78a8671210e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:17 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db Jul 30 16:48:17 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:17 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" returned: 0 in 0.402s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:17 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec Jul 30 16:48:17 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:17 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db" returned: 0 in 0.382s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-754c70a3-aa47-4c70-813d-dee010624963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af20f1-5513-4f39-ba4a-871601bd7320]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:17 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" returned: 0 in 0.249s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Lock "cinder-quobyte-3b8d98c4-63f5-4100-ab89-3879a8eed4ec" released by "delete_volume" :: held 0.722s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:17 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Created reservations ['0dc4957b-dfe6-4fa6-a0b7-346fda056dc5', '6f093bd1-3c18-49c8-b6e9-fe2bcb74f526', '74853d63-450d-4feb-b498-d9fd70cf924a', 'c881d205-5cde-49c0-b9b6-a76c1ca2c80e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:17 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 Jul 30 16:48:17 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:18 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:48:18 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:18 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963" returned: 0 in 0.369s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:18 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db Jul 30 16:48:18 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:18 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.263s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:18 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Deleted volume successfully. Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-33ab0e16-ac39-47d2-9f1e-e15a350474fe tempest-ProjectReaderTests-1373598765 None] Lock "cinder-3b8d98c4-63f5-4100-ab89-3879a8eed4ec-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:18 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db" returned: 0 in 0.368s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:18 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db Jul 30 16:48:18 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:18 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963.f1804939-7856-439b-a953-332264ae12db" returned: 0 in 0.278s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-f1804939-7856-439b-a953-332264ae12db" released by "_delete_snapshot" :: held 1.530s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:18 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-754c70a3-aa47-4c70-813d-dee010624963" released by "delete_snapshot" :: held 1.554s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:19 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Created reservations ['ad950325-9f2e-4942-9c66-5aaa65c9ee7f', 'b0abc629-3c4a-4b54-9a97-787769809d66', '33bf42cc-8b16-4078-a1fa-e8d20e9e4b21', '13f9d2ce-47e2-4bb6-ba59-6354d3efc6b4'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:19 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Delete snapshot completed successfully. Jul 30 16:48:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2c36b311-4378-431b-8994-10331c6f72e1 tempest-ProjectMemberTests-402676597 None] Lock "cinder-f1804939-7856-439b-a953-332264ae12db-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-754c70a3-aa47-4c70-813d-dee010624963-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Lock "cinder-754c70a3-aa47-4c70-813d-dee010624963-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Acquiring lock "cinder-quobyte-754c70a3-aa47-4c70-813d-dee010624963" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:19 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-754c70a3-aa47-4c70-813d-dee010624963" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:19 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf433cb-4b81-4404-9a0c-adfd1d32854e]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:19 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:19 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 Jul 30 16:48:19 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:20 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963" returned: 0 in 0.429s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:20 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963 Jul 30 16:48:20 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:20 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-754c70a3-aa47-4c70-813d-dee010624963" returned: 0 in 0.268s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Lock "cinder-quobyte-754c70a3-aa47-4c70-813d-dee010624963" released by "delete_volume" :: held 0.795s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Created reservations ['31c81e84-f5af-416a-ab7f-2cc7342fd626', '27b077d5-5eb7-4946-8ad0-d6cb926d4641', '8ebd6400-2aba-44d5-8f0e-5bf715ee78c4', 'ca42f63a-f3e2-4570-a6e7-c20c433ec70e'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:20 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:48:20 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:20 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.287s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:20 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Deleted volume successfully. Jul 30 16:48:20 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-5d1b2bd7-e5a1-41be-adf4-ec74ba32015a tempest-ProjectMemberTests-402676597 None] Lock "cinder-754c70a3-aa47-4c70-813d-dee010624963-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:30 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=191,cinder:DELETE=31,cinder:UPDATE=274,cinder:INSERT=71 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:48:30 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=222,cinder:INSERT=78,cinder:UPDATE=282,cinder:DELETE=16 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:47 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:48:47 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:47 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.350s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG oslo_service.periodic_task [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] Running periodic task VolumeManager._thread_info {{(pid=88095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread count: 28 {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:48:47 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-78e03bad-ea01-4a3a-a4d3-bf887bd26c69 None None] thread info: [<_MainThread(MainThread, started 125254113337472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Flow 'volume_create_manager' (978ea922-c79c-4f63-ae4b-6ea21876a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e349d1a-97bb-44ac-95f6-6f675c01a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e349d1a-97bb-44ac-95f6-6f675c01a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1934030923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16cc5c2-01e0-4822-b7db-5d46e99bb805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b993eaaea5b455f9170affd6f28eb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:53Z,use_quota=True,user_id='76f2f0957b6d4a93a048f03681fec46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a9e859-f17a-4bc8-8155-ecaf8ba6b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a9e859-f17a-4bc8-8155-ecaf8ba6b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a22ed9-6529-4596-a60e-6fb3adc7d7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a22ed9-6529-4596-a60e-6fb3adc7d7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16cc5c2-01e0-4822-b7db-5d46e99bb805', 'volume_name': 'volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1df231-689d-48c8-b337-33b6df362ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1df231-689d-48c8-b337-33b6df362ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec43204-68f8-4192-96ec-e14a68c48603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:52 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Volume a16cc5c2-01e0-4822-b7db-5d46e99bb805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805', 'volume_size': 1} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1934030923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16cc5c2-01e0-4822-b7db-5d46e99bb805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b993eaaea5b455f9170affd6f28eb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:53Z,use_quota=True,user_id='76f2f0957b6d4a93a048f03681fec46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)}" {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Creating volume a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:52 devstack cinder-volume[88095]: INFO cinder.volume.drivers.remotefs [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] casted to osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 Jul 30 16:48:52 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 1073741824 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:52 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 1073741824 Jul 30 16:48:52 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:53 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 1073741824" returned: 0 in 0.443s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:53 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 Jul 30 16:48:53 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:53 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805" returned: 0 in 0.281s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'} {{(pid=88095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec43204-68f8-4192-96ec-e14a68c48603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805', 'volume_size': 1}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9a6106-0a5e-4dc0-8341-ba2efee1158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:53 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Volume volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 (a16cc5c2-01e0-4822-b7db-5d46e99bb805): created successfully Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9a6106-0a5e-4dc0-8341-ba2efee1158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:53 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Flow 'volume_create_manager' (978ea922-c79c-4f63-ae4b-6ea21876a035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:53 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-75449a98-268c-4721-9cbe-86d6f2559654 tempest-SnapshotDependencyTests-1795774339 None] Created volume successfully. Jul 30 16:48:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:54 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Creating offline snapshot d93c72b3-154d-4728-bfc8-fa611e3dc211 of volume a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:54 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57040b7-051c-4eb8-ac6e-1738bcb18ace]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:54 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:55 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 Jul 30 16:48:55 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:55 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805" returned: 0 in 0.359s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 1G {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:55 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 1G Jul 30 16:48:55 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:55 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 1G" returned: 0 in 0.420s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:55 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:55 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 Jul 30 16:48:55 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:56 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 -F qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211" returned: 0 in 0.301s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:56 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 is being set with open permissions: ugo+rw Jul 30 16:48:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:56 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 Jul 30 16:48:56 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:56 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211" returned: 0 in 0.251s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:56 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.info Jul 30 16:48:56 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:56 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.info" returned: 0 in 0.264s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:56 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.info is being set with open permissions: ugo+rw Jul 30 16:48:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.info {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:56 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.info Jul 30 16:48:56 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:56 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.info" returned: 0 in 0.237s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:56 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:56 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-a092d6cf-d770-456a-b818-d9fd1d5ac777 tempest-SnapshotDependencyTests-1795774339 None] Create snapshot completed successfully Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Flow 'volume_create_manager' (cd6df372-6918-49df-878e-1dc6a210b0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc63a56e-95d3-49ea-b154-dbda08d662de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc63a56e-95d3-49ea-b154-dbda08d662de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6edf1d8-d1e6-418d-bdd4-eca4fe55d428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b993eaaea5b455f9170affd6f28eb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d93c72b3-154d-4728-bfc8-fa611e3dc211,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:58Z,use_quota=True,user_id='76f2f0957b6d4a93a048f03681fec46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33bcdbb3-240e-4a2d-b664-e5184c5f33d6),volume_type_id=33bcdbb3-240e-4a2d-b664-e5184c5f33d6)' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf44e3a-e852-441e-8d2f-0c20ebde04f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf44e3a-e852-441e-8d2f-0c20ebde04f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a4dea5-68cf-463d-988a-f1b7c1c05055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a4dea5-68cf-463d-988a-f1b7c1c05055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6edf1d8-d1e6-418d-bdd4-eca4fe55d428', 'volume_name': 'volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428', 'volume_size': 1, 'snapshot_id': 'd93c72b3-154d-4728-bfc8-fa611e3dc211'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22d09ac-287a-4277-9463-fbb5ed551ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22d09ac-287a-4277-9463-fbb5ed551ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec8fbdb-25bc-4e07-b684-50a090a736f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:57 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Volume b6edf1d8-d1e6-418d-bdd4-eca4fe55d428: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428', 'volume_size': 1, 'snapshot_id': 'd93c72b3-154d-4728-bfc8-fa611e3dc211'} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-quobyte-d93c72b3-154d-4728-bfc8-fa611e3dc211-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" by "_create_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-d93c72b3-154d-4728-bfc8-fa611e3dc211-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Creating volume b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 from snapshot d93c72b3-154d-4728-bfc8-fa611e3dc211 {{(pid=88095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Selected osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11 as target Quobyte volume. {{(pid=88095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-quobyte-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" by "_copy_volume_from_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] snapshot: d93c72b3-154d-4728-bfc8-fa611e3dc211, volume: b6edf1d8-d1e6-418d-bdd4-eca4fe55d428, {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[804f99d3-d606-4506-9125-557836136b8c]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:57 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:57 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 Jul 30 16:48:57 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:58 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb561c-27bc-4851-ab4c-73be37a07a61]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:58 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 Jul 30 16:48:58 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:58 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805" returned: 0 in 0.357s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Creating direct copy from snapshot {{(pid=88095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG cinder.utils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Path /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 not found in is_blk_device check {{(pid=88095) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:48:58 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:58 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 Jul 30 16:48:58 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:02 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" returned: 0 in 3.814s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG cinder.image.image_utils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805, size 1024.00 MB, duration 3.82 sec, destination /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 {{(pid=88095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:49:02 devstack cinder-volume[88095]: INFO cinder.image.image_utils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Converted 1024.00 MB image at 268.34 MB/s Jul 30 16:49:02 devstack cinder-volume[88095]: WARNING cinder.volume.drivers.remotefs [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 is being set with open permissions: ugo+rw Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:02 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 Jul 30 16:49:02 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:02 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" returned: 0 in 0.228s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" released by "_copy_volume_from_snapshot" :: held 4.868s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-d93c72b3-154d-4728-bfc8-fa611e3dc211-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" released by "_create_volume_from_snapshot" :: held 4.936s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.953s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec8fbdb-25bc-4e07-b684-50a090a736f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428', 'volume_size': 1, 'snapshot_id': 'd93c72b3-154d-4728-bfc8-fa611e3dc211'}' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e9ef50-d54e-4ced-9ee6-5c76cada1ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:02 devstack cinder-volume[88095]: INFO cinder.volume.flows.manager.create_volume [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Volume volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 (b6edf1d8-d1e6-418d-bdd4-eca4fe55d428): created successfully Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e9ef50-d54e-4ced-9ee6-5c76cada1ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:02 devstack cinder-volume[88095]: DEBUG cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Flow 'volume_create_manager' (cd6df372-6918-49df-878e-1dc6a210b0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:02 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c2681b28-1a14-456c-94ae-47c026952617 tempest-SnapshotDependencyTests-1795774339 None] Created volume successfully. Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-d93c72b3-154d-4728-bfc8-fa611e3dc211-delete_snapshot" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-d93c72b3-154d-4728-bfc8-fa611e3dc211-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-quobyte-a16cc5c2-01e0-4822-b7db-5d46e99bb805" by "delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-a16cc5c2-01e0-4822-b7db-5d46e99bb805" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-quobyte-d93c72b3-154d-4728-bfc8-fa611e3dc211" by "_delete_snapshot" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-d93c72b3-154d-4728-bfc8-fa611e3dc211" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Deleting offline snapshot d93c72b3-154d-4728-bfc8-fa611e3dc211 of volume a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] snapshot_file for this snap is: volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 {{(pid=88095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1263c6e6-aeba-43fb-8cb7-3c3256a6faf5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:03 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 Jul 30 16:49:03 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:03 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211" returned: 0 in 0.350s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.remotefs [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa1c754-ca38-425f-9c29-7183d899eb15]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:03 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:03 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 Jul 30 16:49:03 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:04 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805" returned: 0 in 0.548s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:04 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 Jul 30 16:49:04 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:04 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211" returned: 0 in 0.339s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:04 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211 Jul 30 16:49:04 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:04 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805.d93c72b3-154d-4728-bfc8-fa611e3dc211" returned: 0 in 0.259s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-d93c72b3-154d-4728-bfc8-fa611e3dc211" released by "_delete_snapshot" :: held 1.590s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-a16cc5c2-01e0-4822-b7db-5d46e99bb805" released by "delete_snapshot" :: held 1.616s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Created reservations ['9de74a38-1aeb-40ae-b711-3cd6cecaf860', '08f18fbd-5b04-4e31-a6d6-f722e30c931b', 'b389c68c-a759-4ecc-875b-9ee7997fab84', 'e7eaa5d2-372c-4c84-8723-9a6943fd806f'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:04 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Delete snapshot completed successfully. Jul 30 16:49:04 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-2702a2fe-697b-449a-b28d-773b4572782b tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-d93c72b3-154d-4728-bfc8-fa611e3dc211-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-a16cc5c2-01e0-4822-b7db-5d46e99bb805-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-a16cc5c2-01e0-4822-b7db-5d46e99bb805-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-quobyte-a16cc5c2-01e0-4822-b7db-5d46e99bb805" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:05 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-a16cc5c2-01e0-4822-b7db-5d46e99bb805" acquired by "delete_volume" :: waited 0.016s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:05 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4d3cce-ccc4-4cfc-aa6a-ee3373b2d6dd]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:05 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 Jul 30 16:49:05 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:05 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805" returned: 0 in 0.367s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:05 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:05 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805 Jul 30 16:49:05 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:06 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-a16cc5c2-01e0-4822-b7db-5d46e99bb805" returned: 0 in 0.255s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-a16cc5c2-01e0-4822-b7db-5d46e99bb805" released by "delete_volume" :: held 0.683s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Created reservations ['1f39442c-05b6-4bf9-9dce-a2cc981f50ec', '106c323f-be8c-4f76-94db-c2d0e4130fc2', '4d58f3f8-2c9f-47b1-92e9-a27b2326b61f', 'dcbb4d9d-d953-4bb0-8103-ae34580a4202'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:06 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:49:06 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:06 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.277s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:06 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Deleted volume successfully. Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-c1f0a2c2-f138-4197-9c7f-b80161b921ca tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-a16cc5c2-01e0-4822-b7db-5d46e99bb805-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428-delete_volume" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "cinder-quobyte-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" by "delete_volume" {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" acquired by "delete_volume" :: waited 0.015s {{(pid=88095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo.privsep.daemon [-] privsep: reply[353f8259-472f-41d7-b073-4cdf90af60a5]: (4, 'qcow2') {{(pid=89835) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:06 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 Jul 30 16:49:06 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:06 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" returned: 0 in 0.334s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:06 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:06 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428 Jul 30 16:49:06 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:07 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf/volume-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" returned: 0 in 0.240s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-quobyte-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428" released by "delete_volume" :: held 0.609s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG cinder.quota [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Created reservations ['1fe11e83-a674-4356-9acf-73f6560ebcd0', '38287ae2-6fb5-468d-854f-e637d5b08fcd', '5b65dfdd-1d06-424b-a1bb-3db27a350011', '6163cd99-b971-484c-828e-34f8207a4197'] {{(pid=88095) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11': None} {{(pid=88095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG cinder.volume.drivers.quobyte [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9139f5f8-2f50-4474-8e64-bc8dc8023f11'] {{(pid=88095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.lockutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:07 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf Jul 30 16:49:07 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:07 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG oslo_concurrency.processutils [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c73853491d8b69ffcf114894159a8bf" returned: 0 in 0.238s {{(pid=88095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG cinder.manager [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Notifying Schedulers of capabilities ... {{(pid=88095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:07 devstack cinder-volume[88095]: INFO cinder.volume.manager [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Deleted volume successfully. Jul 30 16:49:07 devstack cinder-volume[88095]: DEBUG cinder.coordination [None req-55da0d42-077d-4a46-a31e-be60ae4a5649 tempest-SnapshotDependencyTests-1795774339 None] Lock "cinder-b6edf1d8-d1e6-418d-bdd4-eca4fe55d428-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=88095) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:21 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=4 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:49:21 devstack cinder-volume[88095]: DEBUG dbcounter [-] [88095] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}